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(54) Method and apparatus for image processing. 



(57) The present invention provides an image processing method and apparatus comprising a memory 
process for storing address information of a binary registered image ; a binary converting process for 
converting an original test image into a binary test image so that the ratio of the total number of black 
pixels to the total number of black and white pixels lies within a predetermined range; process for 
aligning the binary test image to the binary registered image in order to compare the two images ; a first 
judging process for judging whether or not a degree of concordance between the binary test image and 
the binary registered image satisfies a predetermined condition of concordance ; and a second judging 
process for judging whether or not a degree of discordance between the binary test image and the 
binary registered image satisfies a predetermined condition of discordance ; in which a judgment is 
made in order to determine whether or not the binary test image is taken from the same object as the 
registered image according to the degree of concordance and the degree of discordance between the 
two images. 



O 
00 

CO 
CM 
<£> 



UJ 



Jouve, 18. rue Saint-Denis, 75001 PARIS 



EP0 623 890 A2 



Background of the Invention 

The present invention relates to image processing method and apparatus, for improving the properties 
(e.g., improving the comparison precision, reducing the processing amount, decreasing the amount of data, 
5 etc.) in the case when conducting image processing for analyzing or recognizing a digitalized image (e.g., fin- 
gerprints, stamped images, diagrams, characters, etc.) using an image processing apparatus (i.e„ hard- 
ware/software in a computer, electronic switching machine, communication control unit, IC card, image rec- 
ognition device, image comparing device, image testing unit, or the like). 

10 Related Art 

In the following, an example of the case in which the objective image according to the present invention 
is a fingerprint will be explained. Essentially, a fingerprint is the crest pattern of the ridges of a finger. Further- 
more, since the trough lines (the space in between the ridge lines) are defined by the ridge lines, it is possible 

is to use a pattern formed by trough lines in place of the ridge lines as a fingerprint. For the sake of convenience, 
the lines defining the fingerprint will be called "fingerprint lines". Various fingerprint input devices exist for con- 
firming an individual's identity, such as a method for inputting a fingerprint from an image pick-up unit (e.g., 
CCD (Charged Coupled Device)) camera, a prism method (e.g., see Shimizu et al., "Entry Method of Fingerprint 
Image with a Prism - Comparison between Total and Light Path Separation Method", IECE Journal, vol. J68- 

20 D, No. 3, pp. 414-415 (1 985)), and a hologram method (e.g., see Igaki, et al., "Personal Identification Terminal 
Using a Holographic Fingerprint Sensor", Institute of Electronics and Communication Engineers of Japan 
(IEICE Technical Report, PRU87-31, pp. 27-33, (1987)). 

The fingerprint image of analog information inputted from an image pick-up unit is converted into a gray- 
scale image of a digitalized fingerprint by means of an analog/digital (A/D) converter. The gray-scale image of 

25 this fingerprint is represented by the coordinates (X, Y) which are an image memory pixel address, as well as 
by means of the brightness of the pixels which form the structural components of each image memory pixel 
address. The designation method for the X and Y axes is optional and may be freely selected. The fingerprint 
image may be formed by converting the concavities and convexities of the fingerprint directly into a binary 
image. 

30 Corrections can then be conducted on the gray-scale image of the fingerprint by means of leveling and 

utilizing the orientation of the ridges. End points, branch points, and points of intersection represent charac- 
teristic points which display the distinctive features of a fingerprint. The characteristic points of a gray-scale 
image of a digitalized fingerprint can be detected by means of conducting binary conversion of a fingerprint 
image and further thinning this image and examining whether or not a pattern identical to the pattern of a range 

35 of pixels (e.g., a 3 x 3 pixel aggregation with the characteristic point as the center) representing the charac- 
teristic point (e.g., see Sasagawa, et al., "Personal Verification System with High Tolerance of Poor-Quality 
Fingerprints", IEICE Journal, vol. J72-D-II No. 5, pp. 707-714 (1990)) exists. In the comparison of fingerprints, 
fingerprints for which information has been previously recorded in memory are referred to as "registered fin- 
gerprints" (i.e., registered images or registered fingerprint images), and the fingerprint which is compared for 

40 concordance with the aforementioned registered fingerprints are referred to as "test fingerprints" (i.e., test im- 
ages or test fingerprint images). As methods for comparing the registered fingerprints and the examined fin- 
gerprints, a method utilizing characteristic points, a method utilizing the orientation of the ridge lines, and a 
method for matching the patterns of the original images of the examined fingerprint and the registered finger- 
print are known. Japanese Patent Application, First Publication, No. Sho 63-132386 discloses a method for 

45 comparing fingerprint images, in which the thinned image of an examined fingerprint and a thinned image of 
the registered fingerprint are superimposed as a method for pattern matching for thinned images (see Kubota, 
et al., "Fingerprint Comparing Method"). 

Smoothing is a process for reducing the effects of noise of the fingerprint image; e.g., a local summation 
averaging filter which utilizes the values of neighboring pixels surrounding a random pixel (Takagi and Shimoda 

50 (Eds.), "Handbook of Image Analysis", pp. 538-548, Tokyo University Press (1991)). 

With regard to the thinning process of a binary image, various pixels corresponding to lines exist, such 
that the majority (in this case, "majority" means at least one-half, and ideally, the entire portion) of the line 
widths represent 1 pixel. The various kinds of corresponding pixels are either black or white; in the following, 
an explanation will be given with regard to the black pixels. Hilditch's thinning method, in which the outer black 

55 pixels of a black pixel aggregation are sequentially deleted while maintaining the continuity between black pix- 
els, is known as a method for thinning a binary image following binary conversion of the gray-scale image (4- 
neighbor connected or 8-neighbor connected). In addition, other methods for thinning a gray-scale image or 
a binary image are also known; e.g., Tamura (Ed.), "Introduction to Computer Image Processing". Sougen 

2 



EP 0 623 890 A2 



Press, pp. 80-83 (1985); Tamura, "Research Relating to Multi-sided Image Processing and its Software", Elec- 
trotechnical Laboratory Japan Research Report, pp. 25-64, No. 835 (February 1984); and Mori, et al., "Fun- 
damentals of Image Recognition [I]". pp. 75-71, Ohm Corporation (1986). Japanese Patent Application No. Hei 
3-45136 (1991), "A Thinning Method for Extracting Characteristic Points of an Image," (Kobayashi, et al., In- 

5 stitute of Electronics, Information and Communication Engineers of Japan PEICE] Technical Report, PRU90- 
149, pp. 33-38(1991 )) discloses a method for thinning a gray-scale image or a binary image. As for connectivity 
between black pixels, either 4-neighbor connected or 8-neighbor connected is used. 4-neighbor connected and 
8-neighbor connected are also called 4-connected and 8-connected, respectively (e.g., see "Introduction to 
Computer Image Processing", Tamura (Ed.), Soken-Suppan, pp. 70, (1985)). 

10 A method for binary converting a gray-scale image into a binary image is disclosed in Mori, et al., ("Fun- 

damentals of Image Recognition [I]", pp. 37-47, Ohm Corporation (1 986)). Ap-tile method is known as a method 
for binary conversion, in which a binary conversion threshold value is determined such that the proportion of 
black pixels among all of the pixels in question following binary conversion (i.e., black or white pixels) reaches 
a predetermined value (e.g., Takagi and Shimoda (Eds.), "Handbook of Image Analysis", p. 503, Tokyo Uni- 
ts versity Press (1 991)). However, this process cannot be directly applied to the case when binary conversion is 
carried out by means of dividing the image into partial regions. 

With regard to the input of fingerprints, positional errors (rotational and parallel displacements) occur when 
comparing a test fingerprint with a registered fingerprint, and hence when carrying out comparison, it is nec- 
essary to align these two fingerprints. As methods for aligning the aforementioned fingerprints (rotational and 

20 parallel displacements), a method which utilizes the ridge orientation, a method which utilizes representative 
characteristic points and peripheral characteristic points, and a method which applies trial and error practice 
over a range in which only parallel displacement is possible to produce a final position of maximum concor- 
dance, are known. Furthermore, at the time of aligning, a conventional method for performing the required co- 
ordinate and geometric transformations is disclosed in Plastock, et al., ("Theory and Problems of Computer 

25 Graphics", translated by Koriyama), pp. 84-88, McGraw Hill Books (1987)). 

In the aligning at the time of comparison, it is useful to calculate the approximate center point of a fingerprint 
image. A method for calculating the approximate center point by means of successively examining ridges with 
sharp increases in their gradients is disclosed in Japanese Patent Application, Second Publication, No. Sho 
58-55548 ("A Method for Determining the Center Position of a Diagram"). In Ito, et al., ("An Algorithm for Clas- 

30 sif ication of Fingerprints Based on the Core", IEICE Technical Report, PRU 89-79, pp. 1 5-22 1 989)). A method 
for successively accessing a center position using the number of intersections of parallel lines of each rectan- 
gular region is disclosed. In addition, in "An Extraction Technique of the Pirot Location for Automated Fingerprint 
Identification Process" (IEICE National Conference on Information and Systems, No. 125 (1987), a method is 
disclosed for calculating the distribution of the number of lines present by counting the number of ridge lines 

35 passing through each scanning line. 

Kobayashi ("A Template Matching Scheme for Fingerprint Image Recognition", IEICE Technical Report, 
PRU91 45, pp. 25 30, July 1991 )) discloses a method for comparing black pixels extracted from a thinned image 
(or narrowed image) of a registered fingerprint and the binary image (or narrowed image) of a test fingerprint 
wherein the processing amount and memory capacity have been decreased to a greater degree than in the 

40 process for comparing two binary images. 

In consideration of the conservation of memory for registered information, it is necessary to decrease the 
memory quantity as much as possible. In the present invention, it is necessary to record the narrow processed 
binary image (line figures) as registered information. As a method for storing line figures, a method is known 
which uses Freeman chain codes (e.g., Yasui and Nakajima, "Image Information Processing", pp. 113-114, Mor- 

45 ikita Publishing (1991)); however, the application of this method to complex images, as in the case of a fin- 
gerprint, is extremely difficult. 

Conventionally, methods such as reversion of the fingerprint lines, thinning, and comparison alignment, 
for example, represent procedures with a large processing amount, at the time of comparison of the fingerprint 
image. In addition, in the comparison method which utilizes characteristic points (end points, branch points, 

so points of intersection) of the image, due to reversion of the fingerprint lines, the processing amount is large, 
and in addition, comparison is difficult in the case when the characteristic points are unclear or indistinct, and 
when the number of these characteristic points is small. In the comparison process which utilizes pattern 
matching of the original images of a registered fingerprint and a test fingerprint, at the time of sealing, the width 
of the ridge lines of the fingerprint are altered due to factors such as the pressure of the finger, existence of a 

55 dry state, and the like, and hence, errors are easily generated and a large memory capacity is necessary to 
store the registered information. 
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Summary of the Invention 

It is an objective of the present invention to provide an image processing method and apparatus comprising 
one or more means for improving the comparison properties of a fingerprint or similar image. In an embodiment 

5 of the comparing method and apparatus according to the present invention, the information (the address group 
of black pixels extracted from a specified range of the image) extracted from a binary image produced by bi- 
nary converting, and thinning or narrowing a registered image, and the binary image of a test image are aligned 
and the concordance of their black pixels are checked to judge whether or not a positive identification (i.e., 
whether or not an individual's identity can be confirmed) can be made. In the following, an outline of the es- 

10 sential components of the image processing apparatus and method for the same according to the present in- 
vention will be explained. 

Increasing the comparison precision in order to improve the image processing properties is accomplished 
by means of selectively utilizing a means forjudging whether the concordance or discordance degree meets 
specified conditions when the ratio of the total number of black pixels to the total pixels falls within a specified 

15 range; a means for checking the presence and position of a hole generated by a white pixel aggregation within 
a black pixel aggregation; a means for examining neighboring pixels when comparing binary converted images; 
and a means for registering the optimum image obtained from reciprocal comparison of one or more images. 

Increasing the quality of the image in order to improve the image processing properties is accomplished 
by means of selectively utilizing a means for performing binary conversion using a threshold value which is 

20 obtained by means of calculating the average brightness for each partial region is calculated, and converting 
the average brightness values in reciprocal intervals of the partial regions; a means for performing binary con- 
version of portions in which little variation of the brightness occurs; and a means for repeatedly performing 
binary conversion in order to keep the ratio of the total number of black pixels to the total number of black and 
white pixels within a fixed range. 

25 Decreasing the processing amount for comparison in order to improve the image processing properties is 

accomplished by means of selectively utilizing a means for sequentially judging the degree of concordance at 
each partial alignment interval such that in the case when image concordance is detected, the comparison 
process is not conducted for partial alignment intervals following the partial alignment interval in which con- 
cordance was detected; and a means for comparing m number of partial alignment intervals (m ^ 1, and is a 

30 predetermined constant), and for determining discordance when the maximum degree of concordance over 
these intervals is less than a specified value. 

In the case when calculation of the degree of discordance during the comparison process is undesirable, 
improvement of the image processing properties is achieved by selectively utilizing a means for using infor- 
mation of a reversed image as reversed registered information and then comparing the registered information 

35 of this reversed registered image, and a reversed test image. 

Brief Description of the Drawings 

FIG. 1 shows a structural example of a fingerprint recognition system according to an embodiment of the 
40 present invention. 

FIG. 2 is a diagram for explaining the usage of an image memory and memory. 
FIG. 3 shows examples of pixel aggregations. 

FIG. 4 shows examples of the divisions of a sub-template and non-sub-template with regard to a fingerprint 
region. 

45 FIG. 5 is a flowchart showing an outline of a procedure IN for continuously confirming the validity of the 

image input and for designating an image. 

FIG. 6 is a diagram for use in explaining the modification of a processing range of an image. 
FIG. 7 is an example of the division of an image into partial regions; this figure is for use in explaining the 
variation of the average brightness of a partial region. 
50 FIG. 8 is a flowchart showing an outline of a binary conversion process occurring in a partial region in which 

there is little variation of the brightness. 

FIG. 9 is an outline example of a process for standardizing the ratio of binary converted black pixels of a 
binary image which has been divided into partial regions. 

FIG. 10 is an example of a table of a valid partial portion of a fingerprint. 
55 FIG. 11 is a diagram for use in explaining a hole (white pixel aggregation) and a non-hole. 

FIG. 12 is a diagram for use in explaining the change from a memory format to a compression format of 
a binary image. 

FIG. 13 is a flowchart showing an outline of a comparison process based on procedure C. 
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FIG. 1 4 is a diagram for use in explaining a method for checking discordant portions in a comparison proc- 
ess. 

FIG. 15 is a flowchart showing an outline of an auxiliary procedure (procedure W) for checking the con- 
cordance of images in a comparison process. 
s FIG. 16 is a diagram for use in explaining the search for neighboring pixels in the comparison process. 

FIG. 17 is a flowchart showing an outline of the fingerprint registration and comparison processes. 

FIG. 18 is a flowchart showing an outline of a registration process wherein the optimum registered finger- 
print from among a plurality of input images is selected. 

FIG. 19 is a flowchart showing an outline for use in explaining the comparison of one test fingerprint against 
w N number of registered fingerprints. 

FIG. 20 is a flowchart showing an outline of the registration and comparison processes at the time when 
using a white/black reversed image. 

Detailed Description of the Preferred Embodiments 

15 

In the embodiments of the present invention, the case in which a fingerprint (also referred to hereafter as 
"fingerprint image") is used as the image is presented. FIG. 1 shows a structural example of a fingerprint iden- 
tification system. The fingerprint input from image input unit 2 is processed in image processing unit 1. Image 
processing unit 1 comprises image memory 4 for storing a gray-scale image, a binary image, and various proc- 

20 essed images of the digitalized fingerprint; central processing unit 5 formed from at least one CPU; and mem- 
ory 6 for recording information such as programs, data, data collections, and the like. In the case when a special 
recording unit is included in memory 6 (e.g., semi-conductor memory, magnetic disc or the like), during mutual 
intervals, the movement of information is performed when necessary by means of hardware and/or software. 
Image memory 4 and memory 6 are classified according to the stored information, however, it is also pos- 

25 sible to incorporate both of these memories into the same recording unit Image input unit 2 comprises an image 
pick-up unit 7. A/D converter 3 converts analog information into digital information (in the case when various 
image input units which can directly receive digital image are used, an A/D converter is unnecessary). The 
pixel address in image memory 4 for storing fingerprint images (gray-scaJe images of digitalized fingerprints) 
is represented by means of X and Y coordinates (X,Y). Pixel address (X,Y) may be indicated by "pixel (X,Y) W 

30 or simply "(X,Y)". The portion of image memory 4 storing a single image is referred to as "image plane". Image 
memory 4 may hold at least one image plane. In addition, pixel address may also be referred to as simply "ad- 
dress". 

Each image plane in image memory 4 is constructed of image pixels, and when the domains of all of the 
pixel addresses are set to 0 ^ X ^ Xh and 0 ^ Y =i Yh, the processing domain specified in the domain these 

35 pixel addresses is processed. In the case when a number with a decimal is generated for the pixel address or 
the number of pixels by means of calculating the sum of the pixel addresses and the number of pixels, proc- 
essing is performed by rounding of these numbers (i.e., 4 or less, round down; 5 orgreater, round up to nearest 
integer). The value of a pixel is expressed by its brightness. The portion of the brightness defining a ridge de- 
pends upon the processing of an image in image processing unit 1, and upon the processing method of image 

40 input unit 2. In both cases, processing is possible by means of presetting brightness characteristics correspond- 
ing to ridges into image processing unit 1. 

An aggregation of one or more pixels is referred to as "pixel aggregation". In fingerprint recognition, the 
fingerprint which is inputted from image input unit 2 for entry into memory 6 of image processing unit 1 is re- 
ferred to as "registered fingerprint", and the fingerprint which is inputted from image input unit 2 for testing is 

45 referred to as "test fingerprint". In an image which has been binary converted into black and white pixels, either 
the black pixels or the white pixels may be selected as the objective pixel corresponding to the ridge lines or 
trough lines of a fingerprint. In embodiments of the present invention, the fingerprint lines will be comprised 
of black pixels. 

Thinning is a process in which the majority portion of a line width is set to equal one pixel. However, in the 
so embodiments of the present invention, the partial or entire narrowing of the line widths of a black pixel aggre- 
gation so that they are included in an image formed by means of the black pixels of an original binary image 
will be referred to as "narrowing process". Accordingly, an image obtained as a result of this narrowing process 
will be referred to as "narrowed image". In the embodiments of the present invention, thinning is one type of 
narrowing process. Furthermore, a line width is defined as the shortest distance (number of pixels) required 
55 to travel from a random point on the margin of one line to the opposite margin of the same line, passing through 
the inner portion of the line. Hence, a line width can be set for each margin position of a line. 

FIG. 2A shows the state of the image data stored in image memory 4. Digitalized images (binary images 
or gray-scale images) obtained from the image inputted from image input unit 2 are stored in the image planes 
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of image 10. In the image planes of image 11, for example, images at the time of input are stored, and can be 
utilized in the processing of image 10. Depending on the selection of the processing procedure, image 11 may 
be unnecessary (in this case, it is possible for memory 4 to utilize only image 10). It is also possible to conduct 
image processing using memory 6 by transferring an image from image memory 4 to memory 6. FIG. 2B shows 

5 the state of data stored in memory 6. Program and data 12 store the programs and data for use in achieving 
the embodiments of the present invention, while registered information 13 places and maintains the registered 
information of a registered fingerprint image in a file. 

With regard to the pixels of an image, a value corresponding to the brightness therein is defined. The bright- 
ness of a pixel address (X,Y) is indicated by f (X,Y). Depending on the method of image input, a gray-scale 

10 image designated by image memory 4 may be produced by means of binary conversion, or a binary image 
may be directly designated by image memory 4. A gray-scale images is an image in which various brightness 
values exists; this variable region of brightness can be applied to random gray-scale images as an objective 
of the present invention. However, for sake of convenience, in the embodiments of the present invention, in 
the case when numerical values are mentioned, the brightness will vary between 0 and 255, with 0 representing 

15 the lowest brightness level (black), and 255 representing the highest brightness level (white). Intermediate val- 
ues therein represent successive values of the brightness between black and white. 

A binary image is expressed by means of black pixels and white pixels only, and the values corresponding 
to the brightness of these respective black and white pixels are defined. The selection of black pixels to rep- 
resent sections of a high brightness or sections of a low brightness is determined by the desired image and 

20 method of input; in the embodiments of the present invention, either case is possible. In the following, in the 
case when consideration must be given to values of brightness (e.g., in the case when stating values relating 
to the brightness), with regard to binary images, the brightness of a black pixel is 0, and the brightness of a 
white pixel is 255. 

The theoretical origin and coordinate axes of an image stored in image memory 4 may be independently 
25 defined as the position of a pixel of a physical image memory 4. The X and Y axes may be randomly designated, 
however, for the sake of convenience, the X-axis possesses a horizontal orientation from left to right (i.e., in 
the direction of increasing value X), and the Y-axis possesses a vertical orientation from top to bottom (i.e., in 
the direction of increasing value Y). 

An aggregation of at least one pixel is referred to as "pixel aggregation". FIG. 3 (a) is a pixel aggregation 
30 formed from pixels arranged in 3 x 3 pixels (i.e., 3 pixels x 3 pixels); FIG. 3 (b) is a pixel aggregation formed 
from pixels arranged in 4 x 4 pixels; and FIG. 3C is a pixel aggregation formed from pixels arranged in 4 x 3 
pixels. In FIG. 3A, pixels {P 1( P 3 , P 5 , P 7 } represent the 4-neighbor connected pixels of P 0 ; pixels {P 1f P 2 , P 3f 
P4. P5. Pe. P7. p e} represent the 8-neighbor connected pixels of P 0 . 

In the embodiments of the present invention, division is performed only when the denominator is not zero. 
35 Notations and definitions used hereafter will be defined below. Some of these notations, however, may 

not appear in the embodiments. 

[m]: Indicates the rounding down of an optional number m. 

I I : Indicates a connection of two numbers of the values shown (e.g. 1 | 1 0 1 1 

1 = 101). 

40 — : Indicates the range between two numbers (e.g., a - b indicates the range 

between a and b which includes both a and b). 
f (X, Y): Indicates the brightness of pixel address (X,Y). 

FA: Fingerprint region; the area inside of this fingerprint region is considered 

the fingerprint boundary. 
45 (Xc, Y c ): Address of the approximate center point of a fingerprint. 

(Xrc> Y rc ): Address of the approximate center point of a registered fingerprint. 

(Xtc. ^tc) : Address of the approximate center point of a test fingerprint 

Rth: Modified image of a registered fingerprint produced by performing at least 

the narrowing process on the binary image (first image) of a registered 
50 fingerprint obtained from a registered fingerprint image (gray-scale image 

or binary image). 

Tth: Modified image of a test fingerprint produced by means of adjusting the 

ratio of the black pixels and/or performing a narrowing process on the bi- 
nary image (second image) of a test fingerprint obtained from a test firv 
55 gerprint image (gray-scale image or binary image). 

RA: Aggregation of all address (X,Y) of black pixels within the fingerprint re- 

gion of the modified image Rth of a registered fingerprint; RA is the sum 
aggregation of RT(0), RB(0), and black pixels within the unused portion 
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RT(0): 



RB(0): 



10 



15 



RT(S): 



RT(S,H,V): 



20 



25 



RB(S,H,V): 



30 



35 



N1m: 



N1c: 



40 N2m: 



45 



N2c: 

Nm: 
Nc: 



50 



Partial region: 
Interval [a, b]: 
55 Alignment interval: 



of a fingerprint region. 

RT(0) is a partial aggregation of RA; RT(0) may designate a sub-region 
of RA in which at least one randomly separated regions of the pixel ag- 
gregation exist: RT{0) is referred to as "sub-template": the portion of an 
image which extracts the sub-template is often referred to as "sub-tem- 
plate portion"; the sub-template is used in the aligning of images (see FIG. 
4). 

RB(0) is a partial aggregation of RA which may designate a sub-region of 
RA one or more randomly separated regions of the pixel aggregation; 
RB{0) is referred to as "non-sub-template"; the portion of an image which 
extracts the non-sub-template is often referred to as "non-sub-template 
portion"; the sub-template is not used in the aligning of images. RT(0) and 
RB(0) are designated such that they do not overlap (see FIG. 4). 
The aggregation of black pixel addresses (X,Y) of sub-template RT(0) at 
the time when the coordinate axes of the modified image of the registered 
fingerprint is rotated S degrees (S°) around a randomly defined center 
point. 

The aggregation of addresses of sub-template RT(0) in the coordinate 
axes following S° rotation of the coordinate axes of the modified image 
of the registered fingerprint around a randomly defined center point (e.g., 
the approximate center point of a registered fingerprint), as well as, after 
conducting horizontal displacement H and vertical displacement V; RT(0, 
0, 0) = RT(0) and RT(S, 0, 0) = RT(S); (further, one pattern which is dis- 
placed by means of coordinate conversion of the modified image of a reg- 
istered fingerprint is defined by means of the values of set {S, H, V) which 
designates a displacement position.). 

The aggregation of addresses of non-sub-template RB(0) in the coordin- 
ate axes following S° rotation of the coordinate axes of the modified image 
of the registered fingerprint around a randomly defined center point (e.g., 
the approximate center point of a registered fingerprint), as well as, after 
conducting horizontal displacement H and vertical displacement V; RB(0, 
0, 0) = RB(0) and RB(S, 0, 0) = RB(S). 

The number of concordant black pixels of the sub-template; indicates the 
number of concordant black pixels between the sub-template of the modi- 
fied image of the registered fingerprint and the modified image of the test 
fingerprint. 

The total number of black pixels of the sub-template; indicates the total 
number of black pixels in the sub-template of the modified image of the 
registered fingerprint. 

The number of concordant black pixels of the non-sub-template; indicates 
the number of concordant black pixels between the non-sub-template of 
the modified image of the registered fingerprint and the modified image 
of the test fingerprint. 

The total number of black pixels of the non-sub-template; indicates the to- 
tal number of black pixels in the non-sub-template of the modified image 
of the registered fingerprint. 

Indicates N1m or N2m; Counter Nm is the value of the counter in the cal- 
culation of Nm. 

Indicates N1c or N2c; Counter Nc is the value of the counter in the calcu- 
lation of Nc. 

The individual regions which result from the division of an image into a 
plurality of parts. 

Indicates the interval between two optional values, a and b, which in- 
cludes both a and b. 

Indicates the range over which an image is displaced in order to align two 
images (group of displacement intervals for each direction), and is con- 
structed from {rotational displacement interval, horizontal displacement 
interval, vertical displacement interval). 
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10 



Partial alignment interval: 



Displacement position: 



The individual alignment intervals resulting from division of an alignment 
interval into at least one partial group; the entire alignment interval is the 
aggregate sum of at least one partial alignment interval. 
Position expressed by one group {rotational displacement position, hori- 
zontal displacement position, vertical displacement position}. 



Registered fingerprint 

(registered image): Registered Fingerprint image or modified image of a 
registered fingerprint. 



Test fingerprint (test image): Test fingerprint image or modified image of a test fingerprint 

15 Threshold value: A constant value for use in making judgments using the ratio of an eval- 

uation value to a threshold value; the method for defining a threshold val- 
ue differs for each evaluation value. 
FIG. 4 shows an example of the relationship of a fingerprint region defined by means of a fingerprint bound- 
ary to the portion for extracting sub-template RT(0) and to the portion for extracting non-sub-template RB(0), 
20 in image 1 0 of image memory 4. Examples 1 - 3 are examples of the sub-template and non-sub-template por- 
tions. 

In the following, the procedure for processing a fingerprint image will be explained. Further, with regard 
to each step of the procedure, in the case when the subsequent process is not mentioned, the procedure pro- 
gresses to the subsequent step. The constants used in each step take into consideration the various conditions 
25 of image processing unit 1 and image input unit 2, and designate statically or dynamically appropriate value. 
The realization of each step as well as the processes linked therein, may be modified provided that the contents 
of the processing remain the same. 

(1) Means for designating a Fixed Moment of Input from Image Input Unit to Image Memory 

30 

Image 10 which is inputted from image input unit 2 to image memory 4 varies according to the movement 
the object of image pick-up unit 7 (i.e., in the case when the object is a fingerprint, a finger is put on image 
input unit 2). As a result, it is necessary to define the moment which designates image 10 of image memory 
4. This processing method comprises: 
35 (a) A method for recognizing the fixed moment of an image by means of a signal sent from image input 

unit 2 to image processing unit 1 ; 

(b) A designating method by means of which a user designates the fixed moment of an image to image 
processing unit 1; or 

(c) A defining method by means of which image processing unit 1 defines the fixed moment of an image 
40 by means of checking the state of image 10 of image 4. 

In the following, an example of method (c) will be provided. 

When the gray-scale image of a fingerprint has been correctly inputted, the average brightness value lies 
within a fixed range, and when this state continues, a stable image can be obtained. Utilizing this aspect, in 
order to increase the quality of the image defining this input, the average brightness value of a previously de- 
45 fined pixel aggregation of the image (e.g., the entire region of the image or one or more partial regions) is cal- 
culated. When this average brightness meets specific conditions, the aforementioned image is judged to be 
a valid image, and when this process is continued such that the number of valid images recognized exceeds 
a specified number, the last image of image memory 4 which is temporarily fixed is designated. 

Based on the aforementioned, an example of the designating method for designating the fixed moment 
50 of image input is shown in procedure IN. 

(Procedure IN) 

Step IN1: 

55 

Counter Fa is reset to "0". 
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Step IN2: 

The image input process is commenced, and image of the image memory is temporarily fixed. 
5 Step IN3: 

Within a specified region of the image, the average brightness Eav of this specified region is calculated, 
and when this average brightness of this specified region meets certain conditions, the image is judged to be 
valid, and the procedure moves to step IN4. If the average brightness does not meet the aforementioned con- 
to ditions, the image is judged to be invalid, and the procedure returns step IN1. 

Average brightness E w of a specified region = (Sum of brightness of pixels within the specified region) / (total 
number of pixel within the specified region) 
wherein E L ^ E av ^ E H ; 

E L and E H are constants which are defined taking into consideration the variable region of brightness in the 
15 case when the image to be processed is inputted. 

Furthermore, in the case when a plurality of specified regions exist, the average brightness of the specified 
regions is checked against the specified conditions for each region, and when the number of valid specified 
regions exceeds a certain threshold value, the image is judged to be valid. 

20 Step IN4: 

"1" is added to counter Fa. 

Step INS: 

25 

Fa is checked as to whether or not it has reached a specified value Fat; in the case when Fa has reached 
a specified value Fat, the procedure moves to step IN6. In the case when Fa has not reached this specified 
value, the procedure returns to step IN2. The value of constant Fat is designated according to the shortest 
number of cycles required for the inputted image to be stabilized. 

30 

Step IN6: 

The image of image memory is designated (end of procedure IN). 

FIG. 5 is an outline showing the flow of procedure IN for designating an image by means of continuous 
35 recognition of the input and validity of the image. 

(2) Image Modifying Means 

The properties of the image inputted from image input unit 2 to image processing unit 1 can be improved 
40 more effectively by using a smaller number of pixel in the processing over a range in which the recognition 
precision remains the same. For example, in the case when the number of pixels of the image memory is larger 
than the number of pixels to be processed (e.g., when the number of pixels of image memory 4 is 640 x 480 
pixels (X = 0 - 639, Y = 0 ~~ 479), and the number of pixels to be processed is 256 x 240 pixels (X = 0 - 255, 
Y = 0 - 239)), after the image is inputted into image memory 4, the range of the image corresponding to the 
45 input is checked, and a partial aggregation of the image is extracted as a provisional image. Furthermore, from 
this provisional image, a small image corresponding to the required number of pixels for processing is extract- 
ed, and this small image is then converted into a normal image for processing. An example of this image mod- 
ifying means is shown by procedure ET. 
(Image modifying procedure ET) 

50 

Step ET1 (Extraction of the small image in the X-direction): 

Steps ET1a - ET1d are executed. 

55 Step ET1a (Determination of the X-coordinate of the left margin of the provisional image possessing a 
black pixel): 

Ka represent the increasing width in the X-direction (e.g., Ka = 1); the following process is conducted until 
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the left margin of the provisional image is found wherein u = 0, Ka, 2Ka, 3Ka, ... (in order). 

The total value GA (u) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja ( ... ) which is extracted in the 
Y-direction at the time when Y = u is calculated, and the value of u, at the time when the existence of a bright- 
ness corresponding to a black provisional image is initially confirmed, is designated as the X-coordinate of the 

5 left margin of the provisional image. For example, in the case when the image possesses only high brightness 
values in a state when there is no image input, and if Ja represents increasing width in the Y-direction (e.g., 
Ja = 1), the value of u at the time when it is confirmed that GA (u) < GA, is designated as the X-coordinate of 
the left margin of the provisional image (note: it is also possible to add the conditions of GA (u + Ka) < GA in 
order to further increase the reliability of the aforementioned). Constant GA is the threshold value indicating 

10 that a black provisional image is present at the time of binary conversion; the total brightness value of provi- 
sional extracted in the Y-direction is defined by taking into consideration the brightness value wherein this value 
approaches a minimum value at the time when black provisional images are incorporated. 

Step ET1b (Determination of the X-coordinate of the right margin of the provisional image possessing a 
15 black provisional image): 

The following process is conducted until the left margin of the provisional image is found wherein v = Xh, 
Xh - Ka, Xh - 2Ka, Xh - 3Ka, ... (in order). 

The total value GA (v) of the brightness of the Y-coordinate (Y = 0, Ja, 2Ja, ... ) which is extracted in the 
20 Y-direction at the time when X = v is calculated, and the value of v, at the time when the existence of a bright- 
ness corresponding to a black provisional image is initially confirmed, is designated as the X-coordinate of the 
right margin of the provisional image. For example, if Ja represents increasing width in the Y-direction (e.g., 
Ja = 1), the value of v at the time when it is confirmed that GA (v) < GA, is designated as the X-coordinate of 
the right margin of the provisional image (note: it is also possible to add the conditions of GA (v + Ka) < GA in 
25 order to further increase the reliability of the aforementioned). 

Step ET1c (Determination of Wx of the X-coordinate of the center point between the left and right margins 
of the provisional image): 

30 The Wx of the X-coordinate of the center point between the left and right margins of the provisional image 

is determined by the following formula. 

Wx = (u + v)/2 

Step ET1d (Determination of the initial X-coordinate for extraction of the small image): 

The initial X-coordinate Xa of the small image is determined by the following formula. 

Xa = Wx - XL/ 2 

XL represents the number of provisional in the X-direction of the small image. In order to standardize the 
size of the small image region, the following equations are formed: 
40 when Xa < 0, Xa = 0; and 

when Xa + X1 - 1 > Xh, Xa = Xh - XL. 

Step ET2 (Extraction of the Y-directional range of the small image): 

45 In step ET2a - ET2d, the same processes as in step ET1 are conducted with regard to the Y-direction in 

order to calculate the Y-coordinate range of the small image. 

Step ET2a (Determination of the Y-coordinate of the upper margin of the provisional image possessing a 
black provisional image): 

50 

Kb represents increasing width in the Y-direction (e.g., Kb = 1); the following process is conducted until 
the upper margin of the provisional image is found wherein u = 0, Kb, 2Kb, 3Kb, ... (in order). 

The total value GB (u) of the brightness of the X-coordinate (Y = 0, Jb, 2Jb, ...) which is extracted in the 
X-direction at the time when Y = u is calculated, and the value of u, at the time when the existence of a bright- 
55 ness corresponding to a black provisional image is initially confirmed, is designated as the Y-coordinate of the 
upper margin of the provisional image. For example, in the case when the image possesses only high bright- 
ness values in a state when there is no image input, and if Jb represents increasing width in the Y-direction 
(e.g., Ja = 1), the value of u at the time when it is confirmed that GB (u) < GB, is designated as the Y-coordinate 
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of the upper margin of the provisional image (note: it is also possible to add the conditions of GB (u + Kb) < 
GB in order to further increase the reliability of the aforementioned). Constant GB is the threshold value indi- 
cating that a black provisional image is present at the ti me of binary conversion; the total value of the brightness 
values of provisional image extracted in the X-direction is defined by taking into consideration the brightness 
5 values wherein this value approaches a minimum value at the time when black provisional are incorporated. 

Step ET2b (Determination of the Y-coordinate of the lower margin of the provisional image possessing a 
black provisional image): 

10 The following process is conducted until the left margin of the provisional image is found wherein v = Yh, 

Yh - Kb, Yh - 2Kb, Yh - 3Kb, ... (in order). 

The total value GB (v) of the brightness of the X-coordinate (X = 0, Jb, 2Jb, ... ) which is extracted in the 
X-direction at the time when Y = v is calculated, and the value of v f at the time when the existence of a bright- 
ness corresponding to a black provisional image is initially confirmed, is designated as the Y-coordinate of the 

15 lower margin of the provisional image. For example, if Jb represents increasing width in the Y-direction (e.g. 
Ja = 1), the value of v at the time when it is confirmed that GB (v) < GB, is designated as the Y-coordinate of 
the lower margin of the provisional image (note: it is also possible to add the conditions of GB (v - Kb) < GB 
in order to further increase the reliability of the aforementioned). 

20 Step ET2c (Determination of Wy of the Y-coordinate of the center point between the upper and lower mar- 
gins of the provisional image): 

The Wy of the Y-coordinate of the center point between the upper and lower margins of the provisional 
image is determined by the following formula. 
25 Wy = (u + v)/2 

Step ET2d (Determination of the initial Y-coordinate for extraction of the small image): 

The initial Y-coordinate Yb of the small image is determined by the following formula. 
30 Yb = Wy - YL/2 

YL represents the number of pixels in the Y-direction of the small image. In order to standardize the size 
of the small image region, the following equations are formed: 
when Yb < 0, Yb = 0; and 
when Yb + YL- 1 > Yh, Yb = Yh - YL. 

35 

Step ET3 (Extraction of the pixels to be processed): 

The range defined by X = Xa ~ Xa + XL - 1 , and Y = Yb - Yb + YL - 1 is then converted into a small image 
for processing. 

40 

Step ET4 (Conversion of the small image into a normal image): 

The conversion for converting the range of the small image into a normal image is performed as necessary; 
e.g., conversion of the designation of the origin, designated location of the image, etc. (End of Procedure ET) 
45 FIG. 6 is a diagram for use in explaining the conversion of the processing range of an image; this figure 

shows examples of the image designated by image memory, provisional image and small image. Furthermore, 
it is also possible to execute procedure ET in only the X-direction or the Y-direction; in this case, the direction 
in which procedure ET is not being performed serves as a fixed range. In the case when the image of image 
memory is used as the image for processing, conversion by means of procedure ET is unnecessary. 

50 

(3) Smoothing Means 

Smoothing is a process for reducing the noise of a fingerprint image. As this smoothing process, any con- 
ventional method may be employed (e.g., use of a local summation averaging filter which utilizes the values 
55 of neighboring pixels around each pixel). 

In the case when a binary image can be directly inputted into image memory 4, smoothing may be omitted. 
A gray-scale image results from the smoothing of a binary image, thus it is necessary to conduct binary con- 
version of this image after smoothing. 
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(4) Binary Conversion and Background Segregation Means: 

Binary conversion is a process for converting a gray-scale image into a binary image. Background seg- 
regation is a process for clarifying the valid range of a fingerprint image of image 10 in image memory 4. In 

5 the following, procedure B will be presented as an example of a procedure for conducting binary conversion 
and background separation. The input information is the input image information. The output information of 
procedure B is the binary image of the output image and the fingerprint boundary information. In the case when 
utilizing an image input unit which can directly input the binary image into image memory 4, binary conversion 
(step B1 ) is omitted, and only background segregation is performed. Similarly, in the case when only binary 

10 conversion is required, i.e., background segregation is unnecessary, it is possible to only perform step B1. 

(Procedure B) 

K is defined as a constant indicating the X-directional length of a partial region. The Y-directional length 
15 of a partial region may differ from the X-directional length of the partial region, however, for the sake of con- 
venience, the case in which these lengths are equal will be presented in the following. In addition, L is defined 
as follows: 

L = (X h + 1)/K 

In the formula, K is selected to produce an integer L In general, it is possible to vary the length of each partial 
20 region. 

=((X h +1)/K) - 1 

With regard to image 10, the partial region addresses, which uniquely and clearly discriminate each partial 
region, are designated as initial pixel addresses for each partial region. A random pixel address (X,Y), at partial 
region address J(M,N), is M =[X/K], and N =[Y/K]. Accordingly, pixel address (X,Y) corresponding to partial 
25 region address J(M, N) is obtained by, performing the following calculations: 

X = K«M,(M = 0,1,2,.. M K max ) 
Y = K • N, (N = 0, 1,2,...,^) 

Step B1 (binary conversion): 

30 

Step B1a: 

Processing is performed with regard to the following: 

M = 0,1.2 K^x 

35 N = 0,1,2,....,^ 

The average brightness B av (M, N) of all of the pixels within each partial region is obtained for each partial region 
J(M, N) using the following equation: 
Bav(M, N) = (the sum of the brightness values of the pixels within a partial region)/(the number of pixels 

within the partial region) 

40 At this point, (M, N) of 

X = K M(M = 0~ K max ) 
Y = K • N (N = 0-K^ 
corresponds to the range of image 10. In other words, when the range of the image are 

0 ^ X ^ Xh 

45 0 ^ Y ^ Yh 

the corresponding range becomes 

M = 0 ~ [Xh/K] 
N = 0 ~ [Yh/K] 

and, 

50 total number of partial regions in image 10 = ([Xh/K] + 1)-([Yh/K]+1). 

In addition, the average brightness of the entire image is obtained as follows. 

Average brightness of the entire image = (Sum of brightness values of the entire image) / (Total number of 

pixels in the entire image). 

55 Step B1b : 

In order to reduce the non-continuity generated by the boundaries of the partial regions, the following mod- 
ifications are carried out when 
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M = 1 -~([Xh/K) " 1) 
N = 1 - ([Yh / K] - 1), then 
Cav(M, N) = (AO ♦ Bav(M, N) + A1 ■ Bav(M + 1, N) + A2 • Bav(M + 1, N - 1) + A3 • Bav(M, N - 1) + A4 
Bav(M - 1. N - 1) + A5 - Bav(M - 1, N) + A6 • Bav(M - 1, N + 1) + A7 - Bav(M, N + 1) + A8 • Bav(M + 1, 
5 N + 1)) / (AO + A1 + A2 + A3 + A4 + A5 + A6 + A7 + A8). 

AO, A1, A2, A3, A4, A5, A6, A7 and A8 are constants which are determined by taking into consideration the 
reciprocal relationships between partial regions. For example, it is possible to set the following: 

AO = A1 = A2 = A3 = A4 = A5 = A6 = A7 = A8 = 1 
The Cav(M, N) of each (M, N) is then stored in the working area of memory. 
10 Subsequently, it is also possible to change the average brightness Bav(M, N) of each partial region ac- 
cording to the reciprocal relationships between the partial regions (M, N) by means of setting Bav(M, N) = 
Cav(M, N) for 

M = 1 ~~([Xh/K] - 1)andN = 1 ~-([Yh/K] - 1). 
FIG. 7 shows an example of the relationship between a partial region (M, N) and the average brightness 
15 Bav(M, N) of this partial region. The method for modifying the average brightness of the partial regions ac- 
cording to the reciprocal relationships of the partial regions is not limited to just the aforementioned processes. 
For example, it is possible to increase or decrease the number of partial regions, as well as change the formula 
of the above-mentioned Cav(M, N) using the reciprocal relationships. 

20 Step B1c: 

(a) The threshold value T with regard to the brightness f(X,Y) of pixel (X,Y) of the partial region for which 
Bav(X.Y) was calculated with respect to each partial region is set as follows: 

T= average value of brightness of a partial region + D + Da 
25 wherein D is a constant for correcting the average brightness value of the partial region. Da is a variable (e.g., 
initially, Da = 0) which will be explained hereafter. 

When f(X,Y) ^ T, (X,Y) for this partial region (M,N), i.e., the (X,Y) of the region defined by 

K - M ^ X ^ K • (M + 1) - 1 
K • N ^ Y ^ K • (N + 1) - 1 

30 designates white pixels (however, when reversing the pixels, (X,Y) designates black pixels); while, on the other 
hand, when f(X,Y) < T, the (X, Y) designates black pixels (when reversing the pixels, (X,Y) is set to white pixels). 

As described in the aforementioned, a binary conversion process is provided in which the average bright- 
ness values of the partial regions serve as essential components of the threshold value. 

When a large number of pixels with high brightness values exist within a partial region, and when the aver- 
ts age brightness values of partial regions in which little brightness variation occurs are high, a large number of 
pixels within a given partial region will be converted to black pixels as a result of binary conversion. In order 
to prevent this aforementioned result, partial regions possessing a high average brightness, in which there is 
little brightness variation, undergo binary conversion using a specified threshold value which is previously de- 
fined, rather than employing the aforementioned binary conversion threshold value. In the following, a concrete 
40 procedure for performing the aforementioned will be explained. 

At every partial region of the original image (gray-scale image), when B av (v) = B m , the above-described 
binary conversion in which the average brightness serves as the threshold value is employed. 

However, when B av ( v ) ^ B m , 
(B m is a value forjudging whether or not the average brightness is a high value; e.g., in the case when a bright- 
45 ness of 180 - 255 is regarded as high, B m = 180) the following calculation is performed for each pixel within 
one random partial region: 

G = | (average brightness of the partial region) - (brightness of each pixel within the partial region) I 
The maximum value G max of these values of G is then calculated, and in the case when G^ ^ B smaJ | (B^i 
represents the upper limit of change in the range of the brightness; e.g., in the case when change of brightness 
so ranges from 0 - 10, a minute variation in brightness may be indicated by B sma ,i = 10), the pixels of the above 
partial region are regarded as showing little variation in brightness, and hence this partial region undergoes 
binary conversion using a specified binary conversion threshold value T = B g (e.g., B g represents the average 
brightness of the entire image or a fixed value). 

This procedure is repeated for all partial regions of the original image. FIG. 8 is a flowchart showing an 
55 outline example of the binary conversion process performed on partial regions in which there is little brightness 
variation. 

In the following process, the brightness states of the image differ depending on the conditions at the time 
of image input. Therefore, the ratio of black pixels of the partial region to total pixels is first calculated, and 
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when this value falls outside of a specif ied range, the value of Da is modified, and binary conversion is repeated 
a specified number of times (at least once). The procedure for optimizing the threshold value of the binary 
conversion will be presented in the following. 

The ratio of black pixels in all valid partial regions Rt> w is calculated as follows: 

5 = (Number of black pixels in all partial regions) / (Total number of pixels in all partial regions) 

When Rb^ ^ ^ Rbw* the ratio of black pixels is normal, and binary conversion can then be completed. 
However, when > R^, T is reduced in order to decrease the number of black pixels. In other words, D a is 
replaced by (D a - D a i). When R^ < T is increased in order to increase the number of black pixels, i.e., 
D a is replaced with (D a + D al ). 

10 Rt*,! and R^ are constants for standardizing the ratio of black pixels: e.g., when a black pixel ratio of 40 

- 45% is desired, R^ and R^ are set to 0.40 and 0.45, respectively. D a1 is a constant for increasing/de- 
creasing the threshold value of the binary conversion (e.g., D a1 = 1 ). When the ratio of black pixels is calculated 
using binary conversion, and this ratio falls outside of a specified range, the threshold value T of the binary 
conversion is modified, and the binary conversion process is repeated a specified number of times. When the 

15 ratio of black pixels remains outside of a specified range even after repeating the binary conversion process 
a specified number of times, the procedure may be abandoned, for example, and then restarted from the input 
of the image. 

D a1 may reduce the processing time in order to allow for the ratio of black pixels to fall within a specified 
range, and may also utilize a plurality of different values in order to increase the probability of the ratio of black 

20 pixels falling within a specified range. With regard to the binary image divided into partial regions, FIG. 9 shows 
an example of the process for standardizing the ratio of binary converted black pixels. The constant group con- 
sisting of D a1 , D a2 and D a3 (e.g., D a1 « 3, = 2, and D a3 = 1) is used for modifying D a . D ai 0 = 1,2, ...) can be 
structured using an optional number of constants. By means of designating an appropriate number of constant 
groups and values, the possibility and convergence speed of converging the value of R|> w to within a specified 

25 range can be improved. Furthermore, in FIG. 9, A 1p , A 1p , A 3p , A lm , A^ and A 3m are parameters which change 
dynamically during the processing in order to select the procedures involved. 

Step B2 (Indication of a valid partial region): 

30 The average brightness of the partial region is then re-calculated with respect to the binary image obtained 

as a result of step B1 . Next, for 

Partial region address l MN = ([X/K],[Y/K]) 
(The partial region address is the initial address of each partial region) 

X = K M,(M= 0,1,2, ...K^ 
35 Y = KN,(N= 0,1,2,...^) 

a judgment of "valid" or "invalid" is rendered for each partial region according to the average brightness value 
B av (X,Y) calculated from the process for calculating the average brightness for each partial region. In other 
words, in a partial region where B L ^ B av (X,Y) ^ B H , this partial region is judged to be a valid partial region, 
and valid indicator is designated in partial region table Y(M,N). 
40 Y(M,N) = {1: Valid partial region. 0: Invalid partial region} 

B L and B H are constants for classifying valid and invalid partial regions. 

Step B3 (Examination of the number of valid partial regions) 

45 From Y(M,N), 

YT = number of valid partial regions 
is counted. When YT s YC (e.g., YC = the total number of partial regions x threshold ratio constant), the pro- 
cedure moves to step B4. When YT < YC, the a shortage in the number of valid partial regions has occurred, 
and hence present procedure ends due to an error. 

50 

Step B4 (Left margin of the fingerprint boundary of a partial region unit): 

The information of the fingerprint boundaries of a partial region is represented by {(N T , M L , Mr), N T = 0 - 
Kfnax}. For each N = N T value, M L ^ M ^ M R is the fingerprint area of the partial region unit. 
55 in this step, the left margin M L of the fingerprint boundary is calculated for the each partial region unit. 

Starting from N=0, the following process is carried out for N=N T , (N T = 0 - K^. Beginning from the left margin 
(M=0) and continuing in the direction of increasing M, a search is sequentially conducted for elements G(M,N) 
possessing an indicator of °1 n (indicating an valid partial region) in table G, which shows the valid partial re- 
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gions. The value M L of the initial M of a section in which indicators having a "1" value are continuous for Kc 
(K c is a constant ^ 1 for judging the fingerprint boundaries of the partial region) indicators or more is set as 
the left margin of the fingerprint area. At M = 0 - K^, when indicators having a value of "1" (indicating an 
valid partial region) are not found to be continuous for Kc indicators or more, the value of the current N is the 
5 non fingerprint area for all M. Additionally, at N T of the non fingerprint area, 

M L = Mr = -1. 

Step B5 (Right margin of the fingerprint boundary for each partial region): 

10 In this step, the right margin M R of the fingerprint boundary is calculated for each partial region unit. Starting 

from N = 0, for N = N T (N T = 0 - K^, any N for which the left marging was not set in step B4 (i.e., N when 
M L = -1) is skipped. Beginning from the left margin (M=K max ) and continuing in the direction of decreasing M, 
a search is sequentially conducted for elements G(M,N) which are indicated by "1" (indicating an valid partial 
region). The value M R of the initial M of a section in which indicators having a value of "1" are continuous for 

15 Kc (Kc is a predetermined number) or more indicators is set as the right margin of the fingerprint area for the 
current N. From the preceding, the partial region fingerprint boundary information {(N Tl M L , M R ), N T = 0 - 
is calculated. 

Step B6 (Fingerprint boundary information of each pixel) 

20 

The fingerprint boundary information of each pixel is calculated from the fingerprint boundary information 
{(N T , M Li Mr), NT = 0 ~ Kroax) for each partial region. The fingerprint boundary information of each pixel is shown 
by {(Y Tl X L , Xr), Y t = 0 ~ (Yh - 1)}. For each value of Y T> X L =i X ^ X R is the fingerprint area. 

According to the fingerprint boundary information of the partial region, in N = 0 - K^, with regard to Y = 
25 Y T ofKxN^Y==KxN + K^, the fingerprint boundary information {(Y T , X L , Xr), Y t = 0 ~ (Yh - 1 )} of each 
pixel is calculated wherein: 

Xl = K • M L 

Xr = K • Mr + Kmax 

(End of procedure B) 

30 FIG. 8 is an example of a table showing the valid partial regions of a fingerprint. From this point on, for the 

sake of simplicity, the term "fingerprint boundary information" will indicate the fingerprint boundary information 
{(Yt. Xl, Xr), Y T = 0 - (Yh - 1)} of each pixel. In addition, with regard to background segregation, it is possible 
to simply process the entire image as the fingerprint region in place of steps B4-B6. 

35 (5) Means for calculating an approximate center point 

With regard to the approximate center point of the fingerprint image, a means is provided for calculating 
the center point ([Xh/2], {Yh/2]) of image 10 or an approximate center point (Xc, Y c ) from among neighboring 
points. In addition, it is also possible to optionally use a conventional means for calculating the approximate 
40 center point. 

(6) Thinning Means 

Thinning is a process for setting the majority of a line width of an image to one pixel. It is possible to op- 
45 tionally use any thinning method (e.g., conventional thinning methods mentioned before) as the thinning 
means. 

(7) Narrowing Process 

50 The narrowing process maintains the majority of the line widths of an image to a specified line width or 

less. This narrowing process is basically achieved by means of standardizing the ratio of black pixels to total 
pixels (optionally, the ratio of white pixels to total pixels or ratio of black pixels to white pixels) in the binary 
conversion process, hence this is considered an aspect of the narrowing process as well. Furthermore, the 
following methods can be used to narrow the line width of a binary image. 

55 Aggregations of one or more black pixels are treated as the lines of an image. The method of maintaining 

the designated line width value is optional, as it is possible to maintain a designated value as input information 
of the narrowing process and/or maintain this value within the narrowing process. It is also possible to maintain 
one or more designated line width values within a single narrowing process. In the preferred embodiments of 
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the present invention, the procedure of narrowing can be appropriately used in response to the designated line 
width value. An example of a narrowing process which depends on the designated line width value is presented 
below. 

(a) Narrowing process for setting the majority of line widths to one pixel (Designated line width value is 
s one pixel) 

It is possible to use a conventional method (i.e., a thinning method which can set the majority of the 
line widths to the width of one pixel) as a procedure for narrowing the line width of a binary image (or a 
procedure for binary converting a gray-scale image and narrowing the line width therein). Furthermore, 
other methods also exist for directly performing binary conversion and narrowing of a gray-scale image. 
10 (b) Narrowing process for narrowing the majority of lines to a width below a designated line width (Desig- 

nated line width value is a random integer) 

This process may also be realized using a conventional method. For example, a method such as the 
following is available. 

i) In the case when a narrowing process, in which the process of removing the components of a line, 
15 one pixel at a time, is repeated from the outer side of a line forming an image (in the preferred embodi- 
ments of the present invention, this corresponds to the black pixels which represent the fingerprint 
lines) until the majority of the line widths are modified to one pixel, it is possible to set the repetition 
number in the narrowing process as follows: 

Repetition number = {(Maximum line width of original binary image) - (designated line width value)}/(Ap- 
20 proximate number of pixels to be deleted from each line width using a single image plane treatment proc- 
ess) 

ii) Narrowing method in which black pixels are kept in the center of the line components forming an 
image 

With regard to the black pixels on the line segment of a section where an random straight line and 
25 the line of an image intersect, narrowing can be accomplished by means of keeping black pixels below a 

designated line width value including the center point of said line segment (in the case when the line seg- 
ment width exceeds the designated line width value, the center point of the line segment is set as the center 
and the black pixels of the designated line width value are kept; all black pixels on the line segment which 
does not satisfy the designated line width value are kept). 
30 In the preferred embodiments of the present invention, when performing the narrowing process on a reg- 

istered fingerprint image and a test fingerprint image, the designated line width value may be randomly set. 
However, it is necessary to define this value on the basis of such factors as the quality and characteristics of 
the input image, the performance with respect to the designated line width value in the narrowing process, the 
performance required by image processing device 1, and the like. If the difference between the designated 
35 line width values in the narrow processing of a registered fingerprint and a test fingerprint, respectively, is large, 
the errors in aligning both images becomes considerable. If this aforementioned difference becomes too large, 
a decrease in the accuracy of the comparison sometimes occurs. Providing a smaller line width for the modified 
image of a registered fingerprint allows for a reduction in the amount of memory required for registered infor- 
mation due to a decrease in the number of pixels. Taking the aforementioned into consideration, either of the 
40 following designations will be effective. 

(a) In the narrowing process of a registered fingerprint image, the designated line width value is set to one 
pixel; in the narrowing process of a test fingerprint, the designated line width value is appropriately set to 
a value of at least two pixels. 

(b) The designated line width values are appropriately selected according to the conditions wherein the 
45 designated line width value for the narrowing process of a registered fingerprint is set to a value smaller 

than the designated line width value of the test fingerprint. 

(c) In the processing of a registered fingerprint image, the designated line width value is set to one pixel; 
in the narrow processing of a test fingerprint, the designated line width value is appropriately adjusted ac- 
cording to the ratio of black pixels at the time of binary conversion (this case is presented in the following 

so embodiment). 

(8) Process for recording the registered information of a registered image 

The process of recording fingerprint information involves extracting sub-template RT(0) and non-sub-tem- 
55 plate RB(0) from the modified image Rth of the registered fingerprint in image 10, which results from inputting 
a registered fingerprint into image 10 of image memory 4 and then performing the above narrowing process, 
and then storing the aforementioned sub-template RT(0) and non-sub-template RB(O) in respective file mem- 
ory. The procedure for performing this recording process of the fingerprint information is illustrated by proce- 
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dure R. The input information of procedure R is the file name of the sub-template and non-sub-template of the 
registered fingerprint, the modified image Rth of the registered fingerprint, the fingerprint boundary information 
of the registered fingerprint and the approximate center point of the registered fingerprint (X rc ,Yr C ). The output 
information of procedure R is the file of the sub-template RT(0) and the file of the non-sub-template RB(0). 

5 

(Procedure R) 

Step R1 (Formation of sub-template RT(0)): 

10 Black pixel addresses within the fingerprint area and within the range of sub-template RT(0) are extracted 

from modified image Rth of the registered fingerprint to form the file of sub-template RT(0). In the storage file 
of RT(0), the approximate center point of the registered fingerprint (X RC ,Y RC ) is also stored. 

Step R2 (Formation of non-sub-template RB(0)): 

15 

A black pixel address which is outside sub-template RT(0) and within fingerprint area FA is extracted from 
modified image Rth of the registered fingerprint to form the file of non-sub-template RB(0). 

Furthermore, storage format of each file of the sub-template and non- sub- template is optional. For ex- 
ample, data may be compressed and stored in a file, and, at the time of utilization, data elongation may be 
20 performed. 

Step R3 

Step R3a (Formation of a file RSa of a sweat gland hole) 

25 

This step is executed in the case when optionally selecting to check a sweat gland hole. In a previously 
determined region of a registered fingerprint, a specified number of addresses corresponding to holes (holes 
formed by white pixel aggregations in a binary image wherein ridge lines are represented by black pixels) 
formed from sweat glands exceeding a predetermined size are calculated by using means for a hole search, 
30 and the central address among these addresses is recorded in the file of a sweat gland hole. 

Step R3b (Formation of a file RSb of a sweat gland non-hole) 

This step is executed in the case when optionally selecting to check a sweat gland non-hole. In a previously 
35 determined region of a registered fingerprint, a specified number of addresses, corresponding to areas in which 
sweat glands exceeding a predetermined size do not exist, are calculated by means of a non-hole searching 
means, and the central address among these addresses is recorded in the file of a sweat gland non-hole. 
(End of procedure R) 

40 (9) Hole Search Means (Procedure WH) 

An example of a hole is shown in FIG. 11 (a). It is possible to detect the aforementioned hole by means of 
the following procedure WH. (Procedure WH) 

45 Step WH1 : 

In searching for a hole in the image, prospective addresses are sequentially examined, and a random white 
pixel address A is selected. With regard to this prospective address, it is possible, for example, to select all of 
the pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

50 

Step WH2 : 

The pixels connected around the neighborhood of the white pixels of address A are checked in order to 
determine whether or not a white pixel aggregation AA, in which a specified number of pixels are connected, 
55 exists. In the case when this white pixel aggregation AA does not exist, the process is re-executed from the 
beginning of procedure WH, while in the case when this white pixel aggregation AA exists, the procedure moves 
to step WH3. 
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Step WH3 : 

In this step, a check is conducted as to whether or not the white pixel aggregation AA is surrounded by a 
group of connected black pixels. In the case when a series of connected black pixels do not surround white 
5 pixel aggregation AA, the process is re-executed from the beginning of procedure WH. In the case when white 
pixel aggregation AA is surrounded by a group of connected black pixels, white pixel address A is recognized 
as the address of a hole. 

Step WH4 : 

10 

The present procedure WH is then repeated on ail prospective addresses to be searched. 
(End of procedure WH) 

(10) Non-Hole Search Means (Procedure NWH) 

15 

An example of a non-hole is shown in FIG. 11 B. It is possible to detect the aforementioned non-hole by 
means of the following procedure NWH. 

(Procedure NWH) 

20 

Step NWH1 : 

In searching for a non-hole in the image, prospective addresses are sequentially examined, and a random 
black pixel address B is selected. With regard to this prospective address, it is possible, for example, to select 
25 all of the pixels, pixels separated by an interval of n pixels (n = 2, 3, 4, etc.), and the like. 

Step NWH2 : 

The pixels connected around the periphery of the black pixels of address B are checked in order to deter- 
30 mine whether or not a black pixel aggregation BB, in which a specified number of pixels are connected, exists. 
In the case when this black pixel aggregation BB does not exist, the process is re-executed from the beginning 
of procedure NWH. In the case when this black pixel aggregation BB exists, black pixel address B is recognized 
as the address of a non-hole. 

35 Step NWH3 : 

The present procedure NWH is then repeated on all prospective addresses to be searched. 
(End of procedure NWH) 

40 (11) Image Data Recording Means 

When storing the address of each black pixel (X,Y) as originally presented in a file, the memory capacity 
required is as follows: 

Memory Capacity = (Number of black pixelsH(Unit memory capacity of X- coordinate) + (Unit memory 
45 capacity of Y - coordinate)] 

It is necessary to store information regarding the sub-template and the non-sub-template, respectively, in 
the files of a registered fingerprint image. In order to reduce the amount of storage data to less than when 
black pixel addresses of a binary image are recorded in their original states, the data is compressed and re- 
corded in a file without an increase in the processing amount. The following process is an example of the afore- 
50 mentioned. 

The following case is for a 4 x 4 pixel aggregation. A4 x 4 pixel aggregation is shown in FIG. 3 for optional 
representative pixel P 0 . The black and white classification of each pixel is shown by bits. With regard to P 0 - 
P 15 , the black pixel and white pixel states of each neighboring pixel can be shown by means of the 2 byte pixel 
aggregation code Q (0000-FFFF by hexadecimal digits), in accordance with the following: 

« Q-P,.l IPul |P«I IPrl IPel IPsI IPJ |P,I IP 2 I |P,I IPo 

The pixel address (X,Y) shown in FIG. 3 (b) which is determined by means of the representative pixel Po=(Xq, 
Y 0 ) and the relative position therein, is expressed as follows: 
Pi: X=Xo-1 Y=Y 0 
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P 2 : 


X=Xo-2Y=Y 0 




P 3 : 


X=X 0 -3, Y=Y 0 




Pa: 


X=Xo,Y=Y 0 - 1 




P s : 


X=Xo-1,Y=Y 0 -1 


5 


Pe: 


X=Xo-2. Y=Y 0 -1 




P7: 


X=Xo-3, Y=Y 0 -1 




P 8 : 


X= Xo, Y= Y 0 - 2 




P 9 : 


X=Xo- 1,Y=Y 0 -2 




P10: 


X=Xo-2,Y=Y 0 -2 


10 


P«: 


X=Xo-3. Y=Y 0 -2 




P«: 


X= Xo, Y = Yq - 3 




P«: 


X=Xo-1,Y=Y 0 -3 




Pu: 


X=Xo-2, Y=Y 0 -3 




Pl5 : 


X=Xo-3,Y=Y 0 -3 


15 


The 


compression processing of the registered fingerprint image data involves converting the (X,Y) coordinate 



of the registered fingerprint image data (X= 0-Xh, Y= 0~Yh) to the following form. With regard to the area 
within the valid region of a fingerprint, each fourth X-coordinate is set to each fourth Y-coordinate as the rep- 
resentative pixel, after which the range of the 4 x 4 pixel aggregation is checked to determine whether or not 
any black pixels exist. The X-coordinate of the representative pixel and the pixel aggregation code are only 

20 stored in the case when black pixels are present. 

In order to designate the portion of the X-address at four pixel intervals, the lower two bits may be used 
as format identification data of the pixel aggregation. In this manner, when half (lower half, upper half or left 
half) of the pixel aggregation code is represented by white pixels, a partial pixel aggregation is expressed by 
one byte of the remaining half of the pixel aggregation code (in accordance with the above-mentioned order, 

25 upper half, lower half, or right half). 

(a) When the format identification data of the pixel aggregation is expressed by a bit indicator of "11", the 
pixel aggregation code is expressed by two bytes (i.e., P 15 | I P u l I »• I I Pi I I Po)- 

(b) When the format identification data of the pixel aggregation is expressed by a bit indicator of "10", the 
pixel aggregation code is expressed by one byte of the upper half (i.e., P 15 | |P 14 | |p 13 | |P 12 II 

30 PiiIIPioIIPqIIPs). 

(c) When the format identification data of the pixel aggregation is expressed by a bit indicator of "01", the 
pixel aggregation code is expressed by one byte of the lower half (i.e., P 7 | |P 6 | |P 6 | |P 4 | |P 3 | | 
P 2 l|PillPo)- 

(d) When the format identification data of the pixel aggregation is expressed by a bit indicator of "00", the 
35 pixel aggregation code is expressed by one byte of the right half (e.g., P 13 | |P 12 I |P 9 I |P 8 I I P 5 I 

IpJIpJIpo). 

When the pixel aggregation code is expressed by 1 byte, the omitted pixels are all white pixels. In the case 
when the pixel aggregation code is expressed by 1 byte, conversion of the X-address portion, incorporating 
two bits for use in the format identification data of the pixel aggregation, into a pure X-address is possible by 

40 means of setting the bit portion for use in the format identification data flag of the pixel aggregation to "0". 

In other words, at the time of compression, the (X,Y) coordinates of the image data (i.e., X= 0-Xh, Y= 
0-Yh) is converted to the following form. Each fourth X-coordinate is set to each fourth Y-coordinate as the 
representative pixel, after which the range of the 4 x 4 pixel aggregation is checked to determine whether or 
not any black pixels exist. The X-coordinate of the representative pixel and the pixel aggregation code are only 

45 stored in the case when black pixels are present. An example of the process for recording the binary image at 
this time is illustrated by procedure G below. 

(Procedure G) 

so StepGI : 

Based on the X-address portion, 4x4 pixel aggregations are sequentially selected. All of the pixels 
(Pis^-Po) are then checked to determine whether or not these pixels are all white pixels. When all of the pixels 
are white pixels, the current 4x4 pixel aggregation is skipped, and step G1 is conducted on the subsequent 
55 4x4 pixel aggregation from the beginning. When all of the pixels are not white pixels, the procedure moves 
to step G2. 
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Step G2 : 

The upper half of the pixel aggregation (Pi 5 -~P 8 ) is then checked to determine whether or not these pixels 
are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G3. When the upper 
5 half contains all white pixels, the lower half of the pixel aggregation (P 7 ^Po) is expressed by a pixel aggregation 
code of 1 byte. The lower two bits of the X-address portion are then set to a bit pattern of "01". 

Step G3 : 

10 The lower half of the pixel aggregation (P 7 -~P 0 ) is then checked to determine whether or not these pixels 

are all white pixels. When all of the pixels are not white pixels, the procedure moves to step G4. When the lower 
half contains all white pixels, the upper half of the pixel aggregation (Pis-Pe) is expressed by a pixel aggre- 
gation code of 1 byte. The lower two bits of the X-address portion are then set to a bit pattern of "10". 

15 Step G4 : 

The left half of the pixel aggregation (P 15 , P 14 , P t , , P 10 , P 7 , P* Pa. P2) is then checked to determine whether 
or not these pixels are all white pixels. When all of the pixels are not white pixels, the procedure moves to step 
G5. When the left half contains all white pixels, the right half of the pixel aggregation 
20 (P i3 1 I P12 1 I P9 1 I Pa M P5 1 I P4 1 I Pi I I Po) is expressed by a pixel aggregation code of 1 byte. The lower two 
bits of the X-address portion are then set to a bit pattern of "00". 

Step G5 : 

25 In this step, the 4 x 4 pixel aggregation is expressed by a pixel aggregation code of 2 bytes. The lower two 

bits of the X-address portion are then left in their original form (i.e., bit pattern of "11"). 

Step G6 : 

30 The processing of this pixel aggregation code and X-address is then completed. 

Step G7 : 

Steps G1 ~ G6 are then repeated with respect to all 4 x 4 pixel aggregations for each X-address. 

35 

Step G8 : 

In this step, the binary image is recorded by setting the file storage format as follows: 
Y-coordinate = Ys, number of groups in stored X-address portion, 
40 {(X-address portion of representative pixel As (including 2 bits of the format identification data of the 

pixel aggregation), Pixel aggregation code), (X-address portion of representative pixel Bs (including 2 bits of 
the format identification data of the pixel aggregation). Pixel aggregation code),...} 



Y- 3 + 4j, number of groups in stored X-address portion, 
45 {(X-address portion of representative pixel Aj (including 2 bits of the format identification data of the 

pixel aggregation), Pixel aggregation code), (X-address portion of representative pixel Bj (including 2 bits of 
the format identification data of the pixel aggregation), Pixel aggregation code), ...} 



Y= Ye: number of groups in stored X-address portion, 

{(X-address portion of representative pixel Ah (including 2 bits of the format identification data of the 
pixel aggregation), Pixel aggregation code), (X-address portion of representative pixel Bh (including 2 bits of 
the format identification data of the pixel aggregation), Pixel aggregation code),...}, {termination indictor} 
(End of Procedure G) 

The number of groups of the stored X-address portion indicates the number of pixel aggregation codes 
corresponding to the Y-coordinate at the time to be stored. The number of groups of the stored X-address por- 
tion are determined without designating a Y-coordinate of "0". In addition, 4x4 pixel aggregations which contain 
only white pixels are not recorded. The pixel aggregation codes may be expressed by either 1 byte or 2 bytes, 
and are classified by the lower two bits of the X-address portion. Furthermore, it is also possible to add groups 



20 



EP 0 623 890 A2 



of termination signals (e.g., of the X-address portion of the representative pixel and pixel aggregation code) 
at each Y-coordinate value in place of the groups of the stored X-address portion. 

FIG. 12A show an example of the case when the image memory is divided into small regions of 4 x 4 pixel 
aggregations. FIG. 12B shows an example of the upper half of a 4 x 4 pixel aggregation. FIG. 12C shows an 
example of the lower half of a 4 x 4 pixel aggregation. FIG. 12D shows an example of the right half of a 4 x 4 
pixel aggregation. Furthermore, in the aforementioned, the case in which the image memory is divided into 
small regions of 4 x 4 pixel aggregations is presented, however, it is possible to optionally designate both the 
size of the small regions and the method of division within the small regions. 

In addition, in order to return the format of the binary image data compressed in procedure G back to its 
original (X,Y) form, it is sufficient to simply reverse the sequence of procedure G. 

(12) Means for Comparing a Registered Image and Test Image 

Comparison process is a process for checking the concordance of each black pixel of a black pixel aggre- 
gation in a modified image of a test fingerprint, with each black pixel in a black pixel aggregation which has 
been stored in memory 6 as registered information relating to the modified image of a registered fingerprint 

Coordinate conversion by means of rotational and parallel displacement in order to align a registered fin- 
gerprint and a test fingerprint, can be carried out for either image. However, in the preferred embodiments here- 
in, the modified image of the registered fingerprint is displaced to align it with the modified image of the test 
fingerprint, since the modified image of the registered fingerprint has a smaller value than the designated line 
width value of the narrowing process. An outline of the comparison process is described below. 

(a) Comparison of the Sub template 

The comparison of the sub-template is the process of calculating the position at which the black pixels 
of the image of the registered fingerprint and the black pixels of the image of the test fingerprint have the 
greatest degree of concordance. In other words, first, a sub-template RT<0,H,V), in which the approximate 
center point of the registered fingerprint has been aligned with the approximate center point of the test 
fingerprint, is calculated for sub-template RT(0) of modified image of a registered fingerprint by means of 
parallel displacement of the coordinate axis of this registered fingerprint Subsequently, following the ro- 
tational and up/down, left/right parallel displacements of the coordinate axis of sub-template RT(0,H,V) in 
the neighboring area about the center, the transformation angle S and the parallel displacement quantity 
(horizontal displacement quantity H, vertical displacement quantity V) of sub-template RT(S,H,V) of the 
modified image of the registered fingerprint, at the point where the degree of concordance between the 
black pixels of the registered fingerprint and the black pixels of the image of the test fingerprint is greatest, 
are calculated (S,H,V are integers). 

(b) Comparison of the non-sub-template, and comparison of the template 

The comparison of the non-sub-template is the process of outputting information relating to the con- 
cordance of the registered fingerprint and the test fingerprint by means of performing coordinate conver- 
sion of the black pixel address of RB(0) of the modified image of the registered fingerprint according to 
S, H, V of RT(S,H,V) of the registered fingerprint obtained in the comparison of the sub-templates to cal- 
culate the black pixel address, and then checking the concordance of this black pixel address with the black 
pixel address of the modified image of the test fingerprint In other words, initially, coordinate transforma- 
tion of the black pixels of non-sub-template RB(0) of the registered fingerprint is performed using the an- 
gular rotational quantity S, horizontal displacement quantity H, and vertical displacement quantity V, of 
the coordinate axes of the sub-template of the modified image of the registered fingerprint obtained above 
to obtain RB(S,H,V). Next, the concordance of the black pixels of RB(S,H,V) of the modified image of the 
registered fingerprint to the black pixels of the modified image of the test fingerprint is checked. 

(c) A check is conducted to determine the number of black pixels of a discordant section. 

(d) This check is conducted when optionally selecting to check the sweat glands. 

(e) In accordance with the above results, a final judgment is made with regard to the concordance of the 
registered fingerprint and the test fingerprint Based on the outline of the above process, an example of 
a comparison procedure is shown by procedure C. The sub-template and the non-sub-template of the reg- 
istered fingerprint, the modified image of the test fingerprint and the approximate center point of the test 
fingerprint serve as the input information of procedure C. The output information of procedure C is the com- 
parison result 
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(Procedure C) 
Step CO : 

5 The maximum total range of displacement of the registered image information at the time of comparison 

is expressed as follows: interval [S mln , S max ] represents the rotational angular direction; interval [H^, H^d 
represents the horizontal direction; and interval [V min , V max ] represents the vertical direction. At least one of 
the intervals indicating the displacement direction is divided into one or more partial intervals as follows: 



S m ln 




{S m , n (ls); Is = 


1,2, . 


., Js} 


Smax 




{S max (ls); Is = 


1.2. . 


... Js} 


H m in 




{H m ,„(lh); Ih = 


1.2.. 


...Jh} 


^max 




{H max (lh); Ih = 


1,2. 


.... Jh} 






{V mh ,(lv); Iv = 


1.2. . 


... Jv} 


Vmax 




{VWIv); Iv = 


1.2.. 


... Jv} 



is Interval [S mln , is the aggregate sum of interval {S mln (1), S max (1)l. interval [S mln (2), S max (2)] and in- 

terval [S^Js), S max (Js)]. 

Interval [H mln , H roax ] is the aggregate sum of interval [H mln (1), H^O)], interval [H roln (2), H™^)],..., and in- 
terval lH mln (Jh), H max (Jh)]. 

Interval [V mln , V ma J is the aggregate sum of interval [V m , n (1), V^l)], interval {V min (2) f V max (2)],..., and in- 
20 terval[V mIn (Jv),V max (Jv)]. 

Hereafter, from step C1, the selected partial alignment intervals are sequentially executed with regard to 
all {interval [S mfn <1), S max (1)], interval [S^tf), S ma x(2)],... , and interval [S mJn (Js) f S max (Js)]}, 

{interval [H mln (1), H max (1)], interval |*W2) f HJ2)] and interval [H mln (Jh), HmaxW]}. and 

{interval [V mIn (1) f V max (1)], interval [V mln (2) f V max (2)] and interval [V min (Jv) f V^Jv)]}. 

25 In a random alignment interval, the entire comparison procedure ends when a judgment of concordance 

is rendered, or when a judgment of discordance is rendered after abandoning the following comparison. 

Step C1 (Comparison of the sub-template): 

30 Steps C1a - C1d are executed. 

Step C1a : 

Sub template RT(0) is stored in memory 6 from the file. Subsequently, the following image concordance 
35 auxiliary procedure (procedure W) is executed using sub-template RT(0), S = SminOsJ-Smaxfls) (incremental 
value Ks of S), H = H^OhJ-H^lh) (incremental value Kh of H) and V= V^lvJ-V^lv) (incremental value 
Kv of V) wherein the registered information black pixel search incremental value Kr = Kra, (Kra^1). 

From this result, with regard to S mln (ls)~~S max (ls), Hm,„(lh)~H max (lh), and V^lv^V^lv), the values of S, 
H and V are modified by incremental values Ks, Kh and Kv, respectively, and Sa, Ha, and Va (i.e. the quasi- 
40 optimal values of S, H, and V) are then calculated. 

Step C1b: 

With regard to the respective displacement ranges of S, H and V, 
45 S: (Sa - Dsb) - (Sa + Dsb), incremental value Ksb 
H: (Ha - Dhb) ~ (Ha + Dhb), incremental value Khb 
V: (Va - Dvb) - (Va + Dvb), incremental values Kvb, 

procedure W is executed wherein the registered information black pixel search incremental value Kr = Krb 
(Krb^1), and {S, Hb, Vb} (i.e., the quasi-optimal values of {S, H, V» are calculated. Dsb, Dhb, and Dvb are 
^o constants for defining the displacements range (See C(1)). 

Step C1 c : 

With regard to the respective displacement ranges of S, H and V, 
55 S: (Sb - Dsc) - (Sb + Dsc), incremental value Ksb 
H: (Hb - Dhc) - (Hb + Dhc), incremental value Khb 
V: (Vb - Dvc) ~ (Vb + Dvc), incremental value Kvb, 

procedure W is executed wherein the registered information black pixel search incremental value Kr = Krc 
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(Krc^1), and {Sc, He, Vc} (i.e., the quasi-optimal values of {S, H, V}) are calculated. Dsc, Dhc, and Dvc are 
constants for defining the displacement range. 

Step C1d: 

5 

Procedure W is executed according to S, H, V, 
S=Sc, Dsd=0, incremental value Ksd=0 
H=Hc, Dhd=0, incremental value Khd=0 
V=Vc, Dvd=0, incremental value Kvd=0, 
10 wherein the registered information black pixel search incremental value Kr = Krd (Krd=1), and the optimal val- 
ues {S, H, V) are calculated. Dsd, Dhd, and Dvd are constants for defining the displacement range. From this 
result, each optimal value {S, H, V} wherein the degree of concordance T1 of the sub-template is maximized 
and the sub-template degree of concordance = N 1m /N 1c 
are obtained. Next, for a predetermined number T k1l if 
15 Tl£T k1 

the registered fingerprint and test fingerprint are judged to be concordant by means of the comparison of the 
sub-templates, and the procedure moves to step C2. On the other hand, if 

T1 < T k1 

the registered fingerprint and test fingerprint are judged to be discordant in the partial alignment interval un- 
20 dergoing processing, and the procedure moves to the processing of the subsequent partial alignment interval 
beginning with step C1. When a partial alignment interval for processing no longer exists, the registered fin- 
gerprint and test fingerprint are judged to be discordant, and procedure C terminates. 

In addition, setting T m1 equal to the maximum value of T1 in the partial alignment intervals from 1 to m, 
when 

25 T m1 < T m ki(j)» 

due to the low probability of concordance, subsequent processing of the present partial alignment interval, as 
well as comparison processing of the remaining partial alignment intervals are not executed, the registered 
fingerprint and test fingerprint are judged to be discordant, and procedure C terminates. In order to execute 
the aforementioned judgment, T mk1( j) 0=1,2 m) represents a previously determined constant 

30 

Step C2 (Comparison of the non-sub-template and comparison of the template): 

Using the optimal value {S, H, V) obtained from non-sub-template RB(0) and step C1 as input information, 
an auxiliary image concordance check procedure (procedure W) is carried out As a result, N^ and N2c are 
35 calculated, and the following is then obtained using the result of step C1: 

Template degree of concordance 12 = (N 1m + N 2m ) / (N 1c + N2J Next, for a predetermined constant T^, if 

T2^Tk2 

the registered fingerprint and the test fingerprint are judged to be concordant, and the procedure moves to step 
C3. On the other hand, if 
40 T2 < Tk2 

the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment interval 
undergoing processing, and the procedure moves to the processing of the subsequent partial alignment interval 
beginning with step C1 . When a partial alignment interval for processing no longer exists, the registered fin- 
gerprint and test fingerprint are judged to be discordant thereby resulting in the termination of procedure C. 

45 

Step C3 (Comparison of discordant sections): 

In this step, the discordance of the black pixels of the registered fingerprint and the black pixels of the test 
fingerprint is checked. It is necessary to remove cases in which the number of black pixels in the discordant 
so section of the image of the test fingerprint are too large. For this purpose, the following steps C3a - C3b are 
carried out to approximately obtain and judge the ratio of the black pixels of the discordant section at the point 
where the line width of the binary image of the test fingerprint has been aligned with the modified image of 
the registered fingerprint. 

55 Step C3a : 

The approximate range of the area of comparison of the modified image of the registered fingerprint of 
{S,H,V} is calculated from the ranges of RT(0) and RB(0). The coordinates (X'.V) in the region following mod- 
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ification of coordinates (X,Y) are calculated in the same manner as in procedure W t found by the following for- 
mulae: 

X' = (X - Xr C ) - cos(S) + (Y - Y RC ) sin(S) + X TC - H 
T = - (X - Xr C ) • sin(S) + (Y - Y RC ) cos(S) + Y TC - V 
5 Note: cos(-) and sin( ) represent trigonometric functions. 

Step C3b: 

The number of black pixels of the region of comparison following coordinate conversion of the modified 
10 image of the test fingerprint (i.e., sum aggregation of RT(S,H,V) and RB(S,H,V,)) is counted. In other words, 
T nw = Total number of black pixels in the region of comparison following coordinate conversion of the test 

fingerprint image 

At this time, when the line width of the modified image of the test fingerprint is represented by w, the total 
number of black pixels when this line width is set to the line width of the modified image of the registered 
15 fingerprint (line width X) is given approximately by: 

Tnc = W(w/X) 

When the line width of the modified image of the registered fingerprint reaches one pixel by means of thin- 
ning, it is possible to calculate the number of black pixels of the region of comparison of the modified image 
of the test fingerprint by thinning this modified image of the test fingerprint. In this case, w = X = 1 . In addition, 
20 the following has already been calculated: 

N im + N2m = Number of concordant black pixels within the region of comparison following coordinate con- 
version of the modified image of the test fingerprint and the modified image of the registered 
fingerprint 

Nic + N 2c = Total number of black pixels within the region of comparison following coordinate conversion 
25 of the modified image of the registered fingerprint 

The degree of discordance Tz of the black pixels may, for example, be expressed as follows: 

Tz = (Tnc - N 1m - N 2m )/(N 1C + N 2C ); 

In the above case, when 

lTz| ^T kc , 

30 with regard to the degree of discordance, the registered fingerprint and the test fingerprint are judged to be 
concordant; in the case where these conditions are not met, the registered fingerprint and the test fingerprint 
are judged to be discordant. 

T kc (0 ^ T kc ^ 1) is a constant indicating the allowable rate of discordant black pixels of the binary image 
of the test fingerprint; as this number decreases, the conditions become stricter (note: normally, Tz ^ 0, thus 

35 it is also possible to make the conditions stricter when Tz < 0, then when Tz ^ 0, by using different values for 
T kc )- When the registered fingerprint and the test fingerprint are judged to be discordant in the partial alignment 
interval undergoing processing, the procedure moves to the processing of the subsequent partial alignment 
interval beginning with step C1 . When a partial alignment interval for processing no longer exists, the registered 
fingerprint and test fingerprint are judged to be discordant thereby resulting in the termination of procedure C. 

40 

Step C4 (Comparison of the sweat gland portions): 

In the present step, in order to increase the accuracy of the comparison, it is possible to selectively add 
at least one of the following steps C4a and C4b. 

45 

Step C4a (Checking of holes from sweat glands): 

The hole address modified using optimum value {S, H, V) is checked to determine the existence of a sweat 
gland in the addresses of the modified image of the test fingerprint (note: holes are formed by one or more 
50 white pixels in an image in which the ridge portions of a fingerprint are represented by black pixels following 
binary conversion). The size of the white pixel aggregation to be checked is represented by parameter con- 
stants. Subsequently, when, as a result of performing the following calculation, T^ ^ T^, the checking of the 
hole of a sweat gland is judged to be successful. 

Tfe = (Number of concordant hole addresses) / (Total number of registered hole addresses) 

55 

Step C4b (Checking of non-holes): 



The non-hole address modified using optimum value {S, H. V) is checked to determine the non-existence 
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of a sweat gland in the addresses of the modified image of the test fingerprint. The size of the white pixel ag- 
gregation to be checked is represented by parameter constants. Subsequently, when, as a result of performing 
the following calculation, 

T~4b — T~k4t>, the checking of a non-hole is judged to be successful. 
T 4b = (Number of concordant non - hole addresses)/(Total number of registered non - hole addresses) 
5 Note: 

Tk4b i** 8 threshold value constant 
Step C5 (Final judgment): 

With regard to the processed partial alignment interval, when the sub-template concordance rate, template 
10 concordance rate, discordant section rate, and sweat gland check have been successfully completed, the reg- 
istered fingerprint and the test fingerprint are judged to be concordant, thereby resulting in the termination of 
procedure C. However, when the registered fingerprint and the test fingerprint are judged to be discordant in 
the partial alignment interval undergoing processing, the procedure moves to the processing of the subsequent 
partial alignment interval beginning with step C1. When a partial alignment interval for processing no longer 
15 exists, the registered fingerprint and test fingerprint are judged to be discordant thereby resulting in the ter- 
mination of procedure C. 

(End of Procedure C) 

FIG. 13 is a flow diagram showing an outline example of the above comparison process based on proce- 
dure C. Furthermore, FIG. 13 illustrates an example in which only an interval of an angular rotational direction 
20 S is divided to form partial alignment intervals. 

FIG. 14 is a diagram for explaining the checking of discordant sections in the aforementioned comparison 
process. This figure shows the relationship between concordant and discordant sections when the line width 
of the modified image of a test fingerprint is aligned with the tine width of the modified image of a registered 
fingerprint 

25 Remarks C(1): Each value of the incremental values (Ks, Kh, Kv), which represent the incremental widths of 
the primary displacement in step C1a, is checked as a rough value over a comparatively wide range. Each 
value of the incremental values (Ksb, Khb, Kvb), incorporating the quasi-optimal values of the {S,H,V} obtained 
in step C1a, which represent the incremental widths of the second displacement in step C1b, is checked as a 
precise value over a comparatively narrow range. In this manner, when the range of displacement during align- 

30 ment is large, a greater reduction in the processing quantity can be achieved when compared to the case in 
which fine incremental values are used. 

In step C1 (a multi-stage process comprising 3 steps) of procedure C, the incremental value of each value 
of displacement can be increased to greater than 1 in the first and second steps; in the second and third steps, 
these values can be compared over the range defined by means of the line width in the prior step as the cardinal 

35 point of the quasi-optimal values of S, H, and V which were determined in the prior step; and it is possible to 
reduce the processing quantity of the comparison (approximately proportionate to the position matching search 
repetition) due to the fact that the number of black pixels of the registered image can be limited through a skip- 
ping procedure which skips a fixed number of the black pixels of the registered information in accordance with 
setting the registered information black pixel search width increment Kr to a value of 2 or greater. The maximum 

40 and minimum values of each displacement range (S mln , S,^, H m!n , H max , V min , V max ) are defined according to 
the maximum permissible displacement ranges at the time of fingerprint input. Step C1d is for the purpose of 
determining T1 in step C1 . 

The following characteristics are present (1) The number of search repetitions increases with increasing 
displacement range; (2) The number of search repetitions increases with decreasing incremental value; (3) The 

45 incremental value at a midway step is defined by taking into consideration the incremental width of the imme- 
diately preceding or immediately succeeding step; (4) For steps other than the final step, a skip search is pos- 
sible; (5) When the designation of the translation limits, the incremental value and the jump search is not ap- 
propriate, errors in recognition occurs easily. 

In step C3b f the degree of discordance sections is calculated by approximately setting the line width of 

50 the modified image of the test fingerprint to the line width of the modified image of the registered fingerprint. 
However, it is also possible to calculate the rate of discordant sections by approximately setting the line width 
of the modified image of the registered fingerprint to the line width of the modified image of the test fingerprint. 

(13) Auxiliary Procedure for Checking Image Concordance 

55 

A summary of an auxiliary procedure (Procedure W) for conducting a check on the concordance of two 
images is explained in the following. The approximate center point (X RC ,Y RC ) for each pixel address (X r ,Yr) of 
the sub-template RT(0) or non-sub-template RB(0) of the registered fingerprint undergoes parallel displace- 
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ment so as to become concordant to the approximate center point (X TC ,Y TC ) of the test fingerprint. Next, the 
coordinate axis of the registered fingerprint is rotated, the black pixel (X R@> Y R@ ) address following conversion 
is checked as to whether or not any black pixels exist within the fingerprint area of the modified image of the 
test fingerprint, and parallel displacement is again carried out. 

5 In the case of RT(S,H,V), S, H and V, and T1, N 1m and N 1c are calculated for the time when the degree of 

concordance T1 reaches a maximum for each value of S, H and V. With regard to RB(S,H,V), S, H t and V each 
respectively represent only one case. Additionally, in procedure W, T1 and T2, N 1m and N 2m , and N 1c and N 2c 
are referred to as T\ "N m ", and "N c ", respectively. 

The aggregation of black pixel addresses of a specified portion of the modified image of the registered 

10 fingerprint (either RT(0) or RB(0)), angular conversion quantity S of the coordinate axis (minimum value, max- 
imum value, incremental value), horizontal displacement H of the coordinate axis of the registered fingerprint 
(minimum value, maximum value, incremental value), vertical displacement V of the coordinate axis of the reg- 
istered fingerprint (minimum value, maximum value, incremental value), the modified image of the test finger- 
print and the skip count J based on the skip search of the black pixels of the registered fingerprint serve as 

15 the input information of procedure W. The displacement range is the entire interval or partial interval. 

When comparing the black pixels of the registered fingerprint with those of the test fingerprint, the regis- 
tered information black pixel search incremental value Kr designates the increment by which the black pixels 
of the modified image of the registered fingerprint are searched. For example, when Kr=1 all of the black pixels 
of the modified image of the registered fingerprint are searched, and when Kr=2, every other black pixel of 

20 the registered fingerprint is searched. 

The optimal angular degree of rotation S about the coordinate axis for the registered fingerprint, the optimal 
coordinate axial horizontal displacement quantity H, the optimal coordinate axial vertical displacement quantity 
V, the number of concordant black pixels N m of the modified image of the test fingerprint and the modified 
image of the registered fingerprint in the specified region (either RT(0) or RB(0)), the total number of black 

25 pixels N c of the modified image of the registered fingerprint of the specified region and the degree of concor- 
dance T. 

FIG. 15 is a flow diagram showing an outline of the auxiliary procedure for checking image concordance 
(Procedure W) in the comparison process. An example of the processing of procedure W is explained in the 
following. 

30 

(Procedure W) 

Step W1 (Selection of angle S): 

35 Depending on the input information of angle S, with regard to the designated interval, S is sequentially 

selected by means of the incremental value of S from the minimum value of S to the maximum value of S (i.e., 
the minimum value of S is S^, the maximum value of S is S max , and when the incremental value is Ks, S varies 
from S mln to S^ according to S = S mln (ls), S mln (ls)+Ks,..., S^, following which the procedure moves to step 
W2. 

40 

Step W2 (Coordinate conversion according to angle S): 

With regard to the black pixels of the modified image of the inputted registered fingerprint (either RT(0) 
or RB(0)), and with respect to the black pixel address (Xr,Yr) which is to be searched using the registered in- 
45 formation black pixel search incremental value Kr, 
(a) when S = 0, 

Xr@ = Xr - X RC + X TC 
Yr@ - Y R - Y RC + Y TC 

are set 
50 (b) when S * 0, 

Following parallel displacement to align the approximate center point (Xr C ,Yr C ) of the registered fingerprint 
to the approximate center point of the test fingerprint (X TCf Y TC ), coordinate axis rotation over an angle S° is 
performed with respect to all of the black pixel addresses (X R ,Y R ) of a black pixel aggregation of the modified 
image of an inputted registered fingerprint (either RT(0) or RB(0)). This is carried out according to, 
55 Xr@ = (X« - Xr C ) • cos(S) + (Y R - Y RC ) • sin(S) + X TC 

Y Re = -(XR-XRc)-sin(S) + (Yr-Yrc)cos(S) + Y TC 
Accordingly, an aggregation of all black pixel addresses (Xr^Y^) of the new registered fingerprint at the time 
when H=V=0 is calculated. 
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According to the above, the approximate center (Xr C .Yrc) °f tne registered fingerprint is rotated S degrees 
about the coordinate axis of the registered fingerprint and an aggregation of ail black pixel addresses (Xr@,Y r @) 
of the new registered fingerprint is obtained when: 

Horizontal displacement H = Vertical displacement V = 0 

5 

Step W3 (Calculation of the degree of concordance T): 
Step W3a: 

10 Initially, the counter for the number of concordant black pixels N m and the counter for the total number of 

black pixels N c of the modified image of the registered fingerprint are respectively reset to "0". 

Step W3b : 

is For each address of the aggregation of (Xr@, Y R@ ), the modified image of the test fingerprint is checked 
while applying the following: 

(a) If the aggregation consists of black pixels within the fingerprint area, "I" is added to the counter for the 
number of concordant black pixels N mi and "1" is also added to the counter for the total number of black 
pixels N c of the registered fingerprint. 
20 (b) If the aggregation consists of white pixels within the fingerprint area, or if the aggregation lies outside 

the fingerprint area (treated as neither white nor black), "1" is added to the counter for the total number of 
black pixels N c of the registered fingerprint. 
At this point, a check is performed to determine whether or not the abandonment of the comparison is possible 
for {S,H,V} in the comparison processing of the sub-template. 
25 In other words, since the registered fingerprint information to be checked is an aggregation of black ad- 

dresses, this information is classified into k continuous intervals according to the search sequence; at the end 
of each interval i (i = 1, 2,..., k), when 

counter N c = N d , 

the N m at this time is set to N ml (i=1 ,2,...k), and the degree of concordance up to that point of the pattern defined 
30 according to the values of S, H and V, is represented by N ml / N d and thus, with regard to a constant Tci 
(i=1,2,...,k), in the case when 

M mJ /N cl <T ci , (i = 1.2,...k), 
(T d and k are constants. See Remarks W(1).) 

even if a subsequent check is conducted, there will not be a significant degree of concordance obtained at 

35 the current values of S, H, and V, hence the current S, H, and V values at this point are discarded, and the 
procedure moves to step W4 in order to advance to the subsequent S, H, and V values. 

The following process (neighboring pixel search at the time of comparison) can be selectively performed 
(This neighboring pixel search process can be selectively applied at each processing stage of the sub-template 
RT, and/or at the stage of the non-sub-template RB.). 

40 The case when the black pixel of the modified image of the registered fingerprint of an optional address 

(e.g., address A) within the image corresponds to the black pixel of address A of the modified image of the 
test fingerprint, is referred to as "concordance" or "true concordance" with regard to the pixel. 

When the black pixel of the modified image of the registered fingerprint of an optional address (e.g., ad- 
dress A) within the image corresponds to a white pixel of the same address A of the modified image of the test 

45 fingerprint, the neighboring addresses of address A of the modified image of the test fingerprint are checked 
for the presence of black pixel. When at least one black pixel is present, the black pixel of the modified image 
of the registered fingerprint of address A is judged to be concordant with the black pixel of the modified image 
of the test fingerprint (when it is necessary to distinguish such concordance from true concordance, such con- 
cordance is referred to as "approximate concordance"). At this time, during comparison of the black pixel of 

so the modified image of the registered fingerprint, it is designed such that the approximately concordant black 
pixels, as well as the concordant black pixels of the modified image of the test fingerprint are not used for com- 
parison more than once. In order to achieve this result, the following operations are conducted. 

The modified image of the test fingerprint is placed into the working area of memory. With regard to the 
black pixels of the modified image of the test fingerprint which have been judged to be concordant with the 

55 black pixels of the modified image of the registered fingerprint by means of either true or approximate con- 
cordance, the pixel value of image memory is converted into an intermediate value other than the brightness 
value of a black or white pixel (e.g., when the brightness of a black pixel and white pixel are "0" and "255", 
respectively, the brightness of true concordance is Ba (e.g., a value other than that of a black pixel or white 
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pixel, such as "50"), and the brightness of approximate concordance is Bb (e.g., "100")). In the comparison of 
the black pixel of the modified image of the test fingerprint and the black pixel of the modified image of the 
registered fingerprint, repeated comparison of concordant and approximately concordant black pixels of the 
test fingerprint of addresses within the same image is prevented since previously compared pixel values are 
5 converted to intermediate values in image memory (i.e., the intermediate values of previously compared image 
memories are checked). When the comparison of the modified image of the test fingerprint and the modified 
image of the registered fingerprint using one set of values {S, H, V} is completed, the modified image of the 
test fingerprint is returned to its original state using the information placed into the working area of memory. 

10 Step W3c: 

When step W3b has been completed for all of the addresses of the aggregations of (Xr@, Y R@ ), 

T = N ro /N c 

is calculated, and N m , N c and T for this {S,H,V} are memory stored. 

15 

Step W4 (Parallel displacement according to H and V) 

For the black pixel address (X@, Y@) of the new registered fingerprint when H=V=0, H and V, which have 
been set in the H, V storage area are selected in sequence (when H=V=0, calculation has already been com- 

20 pleted in step 3). When the values of H from its minimum value to its maximum value and the values of V from 
its minimum value to its maximum value are changed sequentially by each increment (i.e., the minimum value 
of H is H mln , the maximum is H max , when the incremental value is Kh, the value of H changes according to H = 
Hmin(lh), H mln (lh)+Kh,... until the maximum is reached; the minimum value of V is V mjn , the maximum is 
Vmax. when the incremental value is Kh, the value of H changes according to V=V mln , V mln +Kv,...), (X@-H, Y@- 

25 V) becomes the black pixel address aggregation of the new registered fingerprint following parallel displace- 
ment, hence processing identical to step W3 is carried out for each set of {S,H,V}. 

Step W5 (Check of unprocessed S): 

30 When a value of an unprocessed S is present, the procedure returns to step W1 ; When a value of an un- 

processed S is not present, the procedure moves to step W6. 

Step W6 (Judgment of the maximum degree of concordance): 

35 For each {S,H,V} f according to each value of S and each {S,H,V} according to the changes in H^Hmto^Hmax, 

V^mto-Vn^, the values of S, H, and V, and the values of T, N m and N c are calculated as the output information 
for the case when T= N m / N c reaches a maximum. Even when only one value for each of S, H, and V, respec- 
tively, is inputted, T, N m and N c are designated as the output information. 
(End of procedure W) 

40 FIG. 16 is a diagram for explaining an example of the neighboring pixel search in the comparison process. 

FIG. 16B, with regard to the black pixel address A of the registered information from a registered fingerprint, 
shows cases: (1) when address A of the modified image of the test fingerprint is a black pixel, address A of 
the modified image of the test fingerprint and address A of the modified image of the registered fingerprint 
are totally concordant; and (2) when address A of the modified image of the test fingerprint is not a black pixel, 

45 e.g., when address B of the modified image of the test fingerprint is a black pixel, address A of the modified 
image of the test fingerprint and address A of the modified image of the registered fingerprint are approximately 
concordant. In addition, FIG. 16B shows the reciprocal relationship of concordance and approximate concor- 
dance; an overlap check is performed in order to prevent the overlap of black pixel of the modified image of 
the test fingerprint, which has already been compared once as truly or approximately concordant, from the 

50 black pixel address of the modified image of another registered fingerprint. 

In other words, black pixel a of the modified image of the registered fingerprint is totally concordant with 
black pixel d of the modified image of the test fingerprint; black pixel b of the modified image of the registered 
fingerprint is approximately concordant with black pixel e of the modified image of the test fingerprint; and black 
pixel c of the modified image of the registered fingerprint is discordant with the modified image of the test fin- 

55 gerprint When checks for total concordance and approximate concordance are performed, it is designed such 
that neither black pixel d nor black pixel e, both of which have already been compared, is overlapped and des- 
ignated again as concordant. 

Furthermore, it is possible to designate the search range forjudging approximate concordance by consid- 
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ering four or eight neighboring pixels, taking into consideration the distortion state of the image at input, etc. 
Remarks W(1): The value of T d (i=1,2,...k) in step W3b is 0 ^ T d ^ 1 f however it is possible to determine this 
value, for example, as described in the following. When total number of black pixels of a modified image of a 
registered fingerprint is set to N c , N c /N c (i=1,2,...k) indicates the progression state of the processing wherein 

5 the range is represented by 0 ^ N^/IMc ^ 1. As N d increases and approaches N CI N ml /N d approaches MJN C , 
which is the degree of concordance with respect to the {S,H,V} currently being checked, thus it is possible to 
set T d such that N d is as large as possible. 

As T d increases, the range for midway abandonment also increases. There is a considerable effect on the 
decrease in the processing amount, however, due to the frequency with which errors in recognition are gen- 

w erated, it is necessary to set an appropriate value for T d . The maximum frequency of this calculation is deter- 
mined according to the set value of k. If midway abandonment of a comparison is carried out one time, the 
calculation for the possibility of midway abandonment for the values of {S,H,V} after that point is not necessary. 
In addition, it is necessary to set a concrete value of T d according to the characteristics of the desired image. 
Furthermore, if the condition expression defining the range of the midway abandonment of the comparison 

15 also defines the degree of concordance up to that point; this condition expression is not limited to the example 
shown in procedure W. 

Remarks W(2): The method of step W2 signifies the following. For all the addresses (Xr.Yr) in step W2, the 
new address following parallel displacement to align the approximate center point (Xr C ,Yr C ) of the registered 
fingerprint concordant to the approximate center point (X TC ,Y TC ) of the test fingerprint is as follows: 
20 Xr0 = X R - (X RC - Xtc) 

Y r #= Y r - (Yrc - Y TC ) 

(Xr#,Yr#) then forms the new address. Subsequently, coordinate axis rotation of S degrees is carried out about 
(X TC ,Y TC ). This may be obtained according to the following: 

X R@ = (Xr # - X TC ) ■ cos(S) + (Yr* - Y TC ) • sin(S) + X TC 
25 = (X R - X RC ) - cos(S) + (Y R - Yrc) • sin(S) + X TC 

Y R@ = - (Xr # - X TC ) * sin(S) + (Y R# - Y TC ) ■ cos(S) + Y TC 
= - (Xr - Xrc) • sin(S) + (Yr - Y RC ) • cos(S) + Y TC 
(It is possible to maintain the values of the variable range of the predetermined angle S by means of the values 
of the sin(-) and cos(-) trigonometric functions.) 

30 

(14) Flow of Registration Processing and Comparison Processing 

FIG. 1 7 is a flow diagram showing an outline of the registration processing and the comparison processing 
of a fingerprint. The registration process is the process of registering the reg istration information of a fingerprint 
35 in memory 6 of image processing unit 1 . The comparison process is the process of judging the concordance 
of a test fingerprint and a registered fingerprint A flow chart outline from input of the fingerprint up until the 
registration or comparison process is shown in the following procedure Z. 

(Procedure Z) 

40 

Steps ZA1 - ZA5 represent the processes common to both the registration processing and comparison 
processing. 

Step ZA1 : 

45 

Input of a fingerprint from image input device 2 into image memory 4. 
Step ZA2 : 

50 Smoothing of the gray-scale image of the fingerprint in image 1 0 of image memory 4. 

Step ZA3 : 

Binary conversion and background segregation of image 10 by means of procedure B. 

55 

Step ZA4: 

Calculation of the approximate center point of the fingerprint image in image 1 0. 
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(End of steps ZA1 - ZA4) 
The following processes are separated into registration processing and comparison processing. 
Steps ZR1 ~ ZR2 are applied during the registration process; these steps record the registered information 
of the registered fingerprint into memory 6. 

5 

Step ZR1 : 

Narrow processing within the fingerprint area is carried out on the binary image (primary image) of the 
registered image in image 10, and a modified image of the registered fingerprint (primary modified image) is 
10 obtained. 

Step ZR2 : 

The processing of registered information of the registered fingerprint is carried out (procedure R). 
15 (End of steps ZR1 ~~ ZR2) 

Steps ZC1 ~ ZC2 are applied during the comparison process; these steps perform the comparison of the 
test fingerprint and the registered fingerprint. 

StepZCI : 

20 

Black pixel ratio standardization or narrowing of the fingerprint area of the binary image of the test finger- 
print (secondary image) in image 10 is performed, and a modified image of the test fingerprint (secondary 
modified image) is obtained. It is not necessary to repeat standardization of the black pixel ratio in the case 
when this process has been performed in step ZA3. 

25 

Step ZC2 : 

Judgment is made on the concordance of the registered fingerprint and the test fingerprint by means of 
the aforementioned comparison processes (procedure C, procedure W). 
30 (End of steps ZC1 ~ ZC2) 

In the registration processing of the image, a plurality of images can be sequentially inputted and main- 
tained. These images are then compared, and the image with the best concordance can be selected as the 
image for registration. FIG. 18 is a flow diagram showing an outline of this registration process by means of 
which the optimum registered fingerprint is selected from among a plurality of input images. An example of 
35 this procedure is shown by procedure RR, 

(Procedure RR) 

Step RR1 : 

40 

The fingerprint image is inputted into image memory, and the inputted fingerprint image is stored in a file. 
This operations is repeated a specified number of times (note: In this example, this specified number is 3 times; 
the files containing the fingerprint images are designated, for example, z1, z2 and z3.). 

45 Step RR2 : 

With regard to the plurality of inputted images, a comparison process is conducted in accordance with the 
following combinations; when concordance is detected, the degree of concordance T2 of each template is re- 
corded into memory. 

50 During this comparison process, at the time when a comparison discordance is generated, the registration 

process is abandoned, and the procedure is re-executed from step RR1. 

When the comparison of registered fingerprint z1 and test fingerprint z2 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 12 . 

When the comparison of registered fingerprint z1 and test fingerprint z3 results in a final judgment of con- 
55 cordance, the degree of concordance T2 of the template is calculated and set as Q 13 . 

When the comparison of registered fingerprint z2 and test fingerprint z1 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 2 i- 

When the comparison of registered fingerprint z2 and test fingerprint z3 results in a final judgment of con- 
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cordance, the degree of concordance 12 of the template is calculated and set as Q23. 

When the comparison of registered fingerprint z3 and test fingerprint z1 results in a final judgment of con- 
cordance, the degree of concordance T2 of the template is calculated and set as Q 31 . 

When the comparison of registered fingerprint z3 and test fingerprint z2 results in a final judgment of con- 
5 cordance, the degree of concordance T2 of the template is calculated and set as Q 32 . 

The number of final judgments of concordance must meet specified conditions (e.g., when the comparison 
process is conducted six times, as described above, specified conditions requiring, for example, at least four 
final judgments of concordance may be designated.). 

Subsequently, the average degree of concordance is calculated for each input image. For example, in the 
10 case when all of the aforementioned comparisons are concordant 
for z1, average degree of concordance Q1 = (Q 12 + Q13) / 2; 
for z2, average degree of concordance Q2 = (Q 21 + Q23) / 2; and 
for z3, average degree of concordance Q3 = (Q 31 + Q 32 ) / 2. 

15 Step RR3 : 

The maximum Qi is calculated from among the average degrees of concordance Qi = {Q1, Q2, Q3}, and 
is registered using the registration information of fingerprint zi corresponding to the i above. 
(End of procedure RR) 

20 The number of input images at the time of registering one fingerprint may be an optionally designated value 
of at least one. Increasing the number of input images increases the possibility of selecting a high quality image 
as the registered fingerprint image, however, this also results in an increase in the registration processing 
amount, thus the number of input images is determined by considering a balance between these aspects. The 
selection of combinations for the comparison of reciprocal regions of the input images is not limited to the above 

25 description, as it is also possible to select only a portion of the aforementioned combinations as well. The proc- 
ess for selecting the fingerprint images for registration is also not limited to the aforementioned use of the aver- 
age degrees of concordance, as other methods are also possible. 

(15) Comparison of 1 to N 

30 

The comparison process described in the aforementioned embodiments judges whether or not one test 
fingerprint is concordant with the registered information of one registered fingerprint. Using this comparison 
process, in order to judge whether or not one test fingerprint is concordant with at least one registered infor- 
mation from among an optional number of registered information, it is clear that the comparison process must 

35 be sequentially performed with regard to each registered information until a judgment of concordance results. 
However, a drawback exists in this process in that increasing the number of registered information results in 
an increase in the processing amount for comparison. 

From among an optional number of registered information, when one registered information which is con- 
cordant with one test fingerprint is discovered, the following procedure NA can be executed. FIG. 19A shows 

40 the relationship between the test fingerprint and registered fingerprint; FIG. 19B is a flow diagram showing an 
outline of this aforementioned 1 to N comparison process. 

[Procedure NA] 

45 The partial interval of {S,H,V} is divided into first, second, .... nth partial segments. The original segment 

{S.H.V} is accordingly the aggregate sum of all partial segments. The partial segments may be provided in- 
dependently from the partial alignment intervals, or optionally may utilize the partial alignment intervals. Asim- 
ple example of a partial segment includes selecting a segment in which concordance occurs frequently (e.g., 
{S=0, H=H mb ~H max , V= V mln ~ VroaJ as the first partial segment, and then selecting a partial segment other than 

so this first partial segment. 

(Procedure NA) 
Step NA1: 

55 

Input of test fingerprint. 
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Step NA2 : 

Sequential selection of partial segments. 

In the comparison of the first partial segment, the comparison of a test fingerprint with registered informa- 
5 tion (1-1.2 n) is performed with respect to the first segment {S,H,V} until concordant registered infor- 
mation is discovered. When it is not possible to find concordant registered information among the registered 
information processed in the first comparison, the procedure proceeds to the second comparison. 

In the comparison of the second partial segment, the comparison of a test fingerprint with registered in- 
formation (i = 1, 2, n) is performed with respect to the second segment {S.H.V} until concordant registered 
10 information is discovered. When it is not possible to find concordant registered information among the regis- 
tered information processed in the second comparison, the procedure proceeds to the third comparison. 

This comparison procedure continues, as described above, until a concordant registered fingerprint image 
is discovered. The procedure ends when a concordant registered fingerprint image is discovered. In the case 
when a concordant registered fingerprint image cannot be found, the procedure ends after processing the last 
15 partial segment. 

(End of procedure NA) 

With regard to the test fingerprint and concordant registered information, according to this above-described 
procedure, the processing amount for comparison up until the discovery of concordant registered information 
can be significantly reduced. 

20 

(16) Substitution of the degree of discordance 

During the comparison process, it is possible to use the following process in place of judging the afore- 
mentioned degree of discordance. 

25 When comparing a binary image for registration and a binary image for testing (binary test image), the 

registration information of the aforementioned binary image for the registration, and the image of the regis- 
tration information in which the black/white pixels of the aforementioned binary image for the registration have 
been reversed (reverse registered image) are separately registered; the concordance of the binary test image 
and the registered information are compared; and the concordance of the reverse image of the binary test im- 

30 age and the reverse registered image of the registered information are compared. When the final judgments 
of the aforementioned two comparisons both indicate concordance, the binary image for registration and the 
binary test image are judged to be concordant, and the check using the degree of discordance (e.g., degree 
of discordance) can be omitted. However, when selecting this procedure, although calculation of the degree 
of discordance can be omitted, drawbacks exist in that the registration amount and comparison time both in- 

35 crease. An example of the process relating to the registration procedure is shown by procedure RVR. An ex- 
ample of the processing relating to the comparison procedure is shown by procedure RVM. 

(Procedure RVR) 

40 StepRVRI: 

The registration process is performed on a fingerprint for registration, and the registration information 
therein is registered. 

45 Step RVR2: 

At the time of binary conversion of the registered fingerprint, the black and white pixels are reversed, fol- 
lowing which the registration process is performed on this binary image (referred to as "reverse binary regis- 
tered image"), and the reverse registered information of the above registered fingerprint is then registered. 
so (End of procedure RVR) 

(Procedure RVM) 

Step RVM 1 : 

55 

A test fingerprint and registered fingerprint are compared using a comparison process. At this point, the 
check of the degree of discordance is omitted. 
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Step RVM2 : 

The white and black pixels are reversed when performing binary conversion of a test fingerprint, and this 
binary image (referred to as "reverse binary test image") is then compared with the reverse registered infor- 
5 mation of a registered fingerprint by means of a comparison process. At this point, the check of the degree of 
discordance is omitted. 

(End of procedure RVM) 

FIG. 20A is a flow diagram showing an example of the process relating to the registration procedure; FIG. 
20B is a flow diagram showing an example of the process relating to the comparison procedure. 

10 

(17) Expansions and Modifications 

The present invention is not limited to the aforementioned embodiments, as it is possible to apply, for ex- 
ample, the following expansions and modifications. The methods of calculating the degree of concordance and 

15 degree of discordance in the image input method, smoothing process, binary conversion process, background 
segregation process, correction process, process for calculating an approximate center point, thinning or nar- 
rowing process, and comparison process are not limited to the descriptions contained in the embodiments and 
claims of the present invention, as modifications, expansions and/or partial omissions utilizing other methods 
(e.g., conventional methods) may also be employed. The method of designating the X and Y-coordinates is 

20 similarly optional. In alignment, when the drift in the rotation is small enough to be ignored, it is possible to 
check only those potential positional errors in parallel displacement, and to judge the maximum degree of con- 
cordance from this degree of concordance. 

In step W2 of procedure W, when the conversion which carries out rotational and parallel displacement is 
performed, the expression for obtaining Xr@ and Y R@ may be utilized. However, this is not limit to the embodi- 

25 ments of the present invention in any manner. For example, it is also possible to utilize the following: 

Xr@ = X« • cos(S) + Y R - sin(S) 
Yr@ = - X R • sin(S) + Y R • cos(S) 
Furthermore, the utilization of coordinate conversion or geometric transformation is similarly not limited to the 
aforementioned. The processing quantity necessary for comparison can be reduced due to the addition of a 

30 value for carrying out rotational and parallel displacement of the sub-template as registered information (in this 
case, the memory quantity increases). 

in the embodiments of the invention of the present invention, the case in which the image is a fingerprint 
is disclosed, however, the present invention can be appropriately applied to any image which is constructed 
from lines. The classification of the sub-template and non-sub-template is not limited, and expansions such 

35 as classifying neither or setting many classifications are also possible. In addition, it is also possible to indi- 
vidually select one or more of the aforementioned processes and respectively apply them to an optional image 
processing apparatus. 

Results of the Invention 

40 

In the present invention, the capabilities of an image processing apparatus in the recognition of a finger- 
print or image similar to a fingerprint can be improved by means of selecting and applying at least one of the 
means and/or processes described in the aforementioned embodiments. The main results of the present in- 
vention are summarized below. 

45 (1) in the comparison of registered information and a test image, during the binary conversion process, 

the fluctuation of the inputted gray-scale image is offset by means of standardizing the ratio of black pixels 
of the test image to a specified range, and hence the precision of the comparison judgment can be in- 
creased. In addition, by means of appropriately setting the specified range of the black pixel ratio, degree 
of concordance and degree of discordance, the recognition error rate (i.e., the probability of mistaking an- 

50 other individual's fingerprint as the fingerprint of the person in question, or vice versa) can also be reduced. 

(2) At the time of binary conversion following division of the image into a plurality of partial regions, the 
discontinuity of the binary image generated at the boundaries of the partial regions can be reduced by 
means of modifying the average brightness value of the partial regions using the reciprocal relationship 
of the partial regions, and by performing binary conversion using this modified average brightness value. 

55 At the time of binary conversion following division of the image into a plurality of partial regions, within 

a partial region, by means of binary converting a partial region possessing an average brightness value 
within a first specified range and a brightness modification amount within a second specified range using 
a threshold value determined with regard to all regions of the image, the noise effects of an image, gen- 
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erated upon using the image input unit, to the binary image following binary conversion can be reduced 
during binary conversion of a minute variable portion of the brightness. 

In the binary conversion in which the binary conversion process is repeated to standardize the ratio 
of black pixels following modification of the brightness threshold value for binary conversion, with regard 
5 to nonuniformity and fluctuation of the brightness of the input image, it is possible for the ratio of black 

pixels to approach the threshold value which results in the ability to clearly define fingerprint lines, as well 
as reduce the fluctuation of the line widths. 

(3) By dividing a displacement interval of at least one direction into a plurality of partial intervals to form 
partial alignment intervals over a displacement range in which alignment comparison occurs, the process- 

10 ing amount for comparison can be significantly reduced when a final judgment of concordance results dur- 

ing sequential comparison of the partial alignment intervals, since the comparison process need is not con- 
ducted on the remaining partial alignment intervals following the interval in which a judgment of concor- 
dance of both images was rendered. 

In addition, the processing amount for comparison can be further reduced since in the aforementioned 

15 partial alignment intervals (1 , 2 n), when a maximum value of the degree of concordance falls outside 

of a specified range, a judgment of discordance is rendered without processing the remaining partial align- 
ment intervals. 

(4) In the case where a random address A in the memory of the registered image is a black pixel, and the 
address A in the memory of a test image is a white pixel, when the a predetermined number of neighboring 

20 addresses of address A of the test image are searched and a black pixel exists, the black pixel of address 

A of the test image is judged to be concordant with the black pixel of address A of the registered image; 
and in subsequent comparison of the above registered image and test image judgments regarding the con- 
cordance of black pixels from other addresses of the registered image which overlap black pixel of address 
A of the test image. Therefore the fluctuation in the distortion of the lines of an image can be effectively 

25 countered by checking the neighboring information of a black pixel of a registered image in the above- 

described manner. 

(5) In the case where an optional check of the portions corresponding to sweat glands of a finger is se- 
lected, during comparison processing of the registered image and test image, when a hole is detected in 
the test image, all registered holes are examined for concordance with this hole, and when the number of 

30 concordant registered holes exceeds a predetermined ratio, a judgment of concordance is rendered with 

regard to the registered image and test image. As a result, an extremely strict comparison can be per- 
formed. 

(6) In the case when, upon comparing a test image and registered information, as well as a reverse test 
image (in which the brightness of the original test image is reversed) and reverse registered information, 

35 both of these comparisons produce successful results, a judgment of concordance is rendered with regard 

to the registered image and testimage. As a result, calculation of the degree of discordance can be omitted. 



Claims 

40 

1. An image processing apparatus comprising: 

memory means for storing address information of a binary registered image; 

binary converting for converting an original test image into a binary test image so that a ratio of a 
total number of black pixels to a total number of black and white pixels lies within a predetermined range; 
45 means for aligning said binary test image to said binary registered image in order to compare said 

two images; and 

first judging means forjudging whether or not a degree of concordance between said binary test 
image and said binary registered image satisfies a predetermined condition of said degree of concor- 
dance; 

50 wherein a judgment is made in order to determine whether or not said binary test image is taken 

from a same object as said binary registered image according to said degree of concordance and said 
degree of discordance. 

2. An image processing apparatus according to claim 1 wherein said binary registered image is obtained 
55 by converting an original image into a binary image so that a ratio of a total number of black pixels to a 

total number of black and white pixels lies within a predetermined range. 

3. An image processing apparatus according to claim 1 wherein said binary registered image is obtained 
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by converting an original registered image into a binary image and thinning said binary registered image; 

said judgment regarding said degree of concordance between said binary test image and said bi- 
nary registered image is made based on said address information of black pixels of said registered image 
and said test image; 

said judgment regarding said degree of discordance between said binary test image and said bi- 
nary registered image is made by comparing discordance of black pixels of said binary test image after 
thinning and black pixels of said registered image, and comparing said degree of discordance with a pre- 
determined value. 

An image processing apparatus according to claim 1 wherein, said binary converting and storing means 
divides said original test image to a plurality of partial regions and obtains each average brightness of 
each partial region, determines a threshold value for each partial image and converts said original test 
image into a binary test image with reference to each threshold brightness determined with reference to 
each average brightness of said partial region and neighboring regions, obtains a ratio of a total number 
of black pixels to a total number of black and white pixels, repeats said binary conversion of said original 
test image to a binary test image by changing said threshold brightness value until said ratio of a total 
number of black pixels to a total number of black and white pixels lies within a predetermined range; 

said image processing apparatus comprises means for converting an original registered image to 
a binary registered image, thinning said binary registered image, and storing address information of black 
pixels of said registered image; 

said judgment regarding said degree of concordance between said binary test image and said bi- 
nary registered image is made based on said address information of black pixels of said registered image 
and said test image; 

said judgment regarding said degree of discordance between said binary test image and said bi- 
nary registered image is made by comparing discordance of black pixels of said test image after thinning 
and black pixels of binary registered image, and comparing said degree of discordance with a predeter- 
mined value. 

A method of processing images comprising the steps of: 

storing address information of black pixels of a binary registered image; 

converting an original test image into a binary test image so that a ratio of a total number of black 
pixels to a total number of black and white pixels lies within a predetermined range; 

aligning said binary test image to said binary registered image in order to compare said two images; 

judging whether or not a degree of concordance between said binary test image and said binary 
registered image satisfies a first predetermined condition of said degree concordance; and 

judging whether or not a degree of discordance between said binary test image and said binary 
registered image satisfies a second predetermined condition of discordance; 

wherein a judgement is made in order to determine whether or not said binary test image is taken 
from a same object as said registered image according to said degree of concordance and said degree 
of discordance between said two images. 

An image processing apparatus comprising: 

means for dividing an original image into partial regions and obtaining an average brightness of 
said partial regions; and 

means for determining a threshold brightness value for binary conversion for each partial region 
with reference to both said average brightness of said each partial region and average brightness values 
of neighboring partial regions; 

wherein each said partial region of said original image is converted into a partial region of a binary 
image with reference to said threshold brightness value. 

An image processing apparatus according to claim 6 wherein said threshold brightness value of a partial 
region is determined with reference to said average brightness values of said partial region and at least 
one average brightness of at least one neighboring partial region. 

An image processing apparatus according to claim 6 wherein said threshold brightness value of a partial 
region is determined to be equal to a predetermined value for said original image if said average brightness 
value of said partial region lies within a predetermined range and each absolute difference value between 
said average brightness and each brightness value of each pixel of said partial region lies within a pre- 
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determined range. 

An image processing apparatus according to claim 6 wherein a ratio of a total number of black pixels to 
a total number of black and white pixels is obtained, said threshold brightness value is altered if said ratio 
of total number of black pixels to a total number of black and white pixels lies outside a predetermined 
range and repeats said binary conversion of an original test image to a binary test image. 

A method of processing images, comprising the steps of: 

dividing an original image into partial regions and obtaining an average brightness of said partial 
regions; and 

determining a threshold brightness value for binary conversion for each partial region with refer- 
ence to both said average brightness of each partial region and average brightness values of neighboring 
partial regions; 

wherein each said partial region of said original image is converted into a partial region of a binary 
image with reference to said threshold brightness value. 

An image processing apparatus comprising: 

memory means for storing address information of black pixels of a binary registered image; 

binary converting means for converting an original test image into a binary test image so that a 
ratio of a total number of black pixels to a total number of black and white pixels lies within a predetermined 
range; and 

means for aligning said binary test image to said binary registered image by moving at least one 
of the images in one or more intervals in order to compare said two images; 

wherein an interval is divided into a plurality of partial intervals and a judgement is made as to 
whether or not said binary test image satisfies a predetermined condition of concordance with said binary 
registered image in one of said partial intervals, 

successively displacing said partial interval until said predetermined condition of concordance is 
satisfied, and said binary test image is judged to be taken from a same object as said binary registered 
image when said predetermined condition of concordance is satisfied. 

An image processing apparatus according to claim 11 wherein said degree of concordance between said 
binary test image and said binary registered image is also calculated for successive predetermined num- 
ber of partial intervals, and said binary image is judged to be taken from a different object as said binary 
registered image if any one of said degree of concordance regarding said predetermined number of partial 
intervals does not lie within a predetermined range. 

A method of processing images, said method comprising the steps of: 

storing address information of black pixels of a binary registered image in a memory device; 

converting an original test image into a binary test image so that a ratio of a total number of black 
pixels to a total number of black and white pixels lies within a predetermined range; 

aligning said binary test image to said binary registered image moving at least one of the images 
in a one or more intervals in order to compare said two images; 

wherein an interval is divided into a plurality of partial intervals and the judgement is made as to 
whether or not said binary test image satisfies a predetermined condition of concordance with said binary 
registered image in one of said partial intervals, successively displacing each partial interval until said 
predetermined condition of concordance is satisfied, and said binary test image is judged to be taken from 
a same object as said binary registered image when said predetermined condition of concordance is sat- 
isfied. 

An image processing apparatus comprising: 

memory means for storing address information of black pixels of a binary registered image; 

binary converting means for converting an original test image into a binary test image so that a 
ratio of a total number of black pixels to a total number of black and white pixels lies within a predetermined 
range; 

means for aligning said binary test image to said binary registered image in order to compare said 
two images; and 

means for judging concordance of a black pixel of said binary test image and said binary registered 
image wherein pixels of said binary test image are compared with pixels of binary said registered image, 
and binary information of a pixel of said test binary image is regarded to be concordant with binary infor- 
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mation of a pixel of said binary registered image at a corresponding address if each of said binary infor- 
mation of said two pixels is equal or if binary information of at least one of neighboring pixels around said 
pixel of said test image is equal to said pixels of said binary registered image, 

wherein each pixel of said binary test image that is regarded as concordant with binary information 
of each pixel of said binary registered image is selected without overlapping. 

15. An image processing apparatus according to claim 14 wherein said neighboring pixels around said pixel 
are pixels 8-neighbor connected to said pixel. 

16. A method for processing images, said method comprising the steps of: 
storing address information of black pixels of a binary registered image; 

converting an original test image into a binary test image so that a ratio of a total number of black 
pixels to a total number of black and white pixels lies within a predetermined range; 

aligning said binary test image to said binary registered image in order to compare said two images; 

and 

judging concordance of a black pixel of said binary test image and said binary registered image 
wherein pixels of said binary est image are compared with pixels of said binary registered image and bi- 
nary information of a pixel of said binary test image is regarded to be concordant with binary information 
of a pixel of said binary registered image at a corresponding address if each of said binary information 
2Q of said two pixels is equal or if said binary information of at least one of neighboring pixels around said 

pixel of said test image is equal to said pixel of said binary registered image, 

wherein each pixel of said binary test image that is regarded as concordant with binary information 
of each pixel of said binary registered image is selected without overlapping. 
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17. An image processing apparatus for judging concordance of a binary test image and a binary registered 
image, said image processing apparatus comprising: 

means for discovering holes in said binary registered image, each hole being an aggregate of white 
pixels surrounded by black pixels; 

means forjudging concordance of said binary test image and binary registered image wherein a 
hole in said registered image is regarded to have a corresponding hole in said binary test image when 
addresses of said two holes satisfy a predetermined relationship, and said two images are regarded to 
be originated from a same object if a corresponding number of holes between said binary registered image 
and said binary test image lies within a predetermined range. 

18. An image processing apparatus comprising: 

binary converting means for converting an original registered image into a binary registered image; 
memory means for storing address information of black pixels of said binary registered image; 
reverse means for obtaining a reverse image of said original registered image; 
binary converting means for converting said reverse image into a binary reverse registered image; 
memory means for storing address information of black pixels of said binary reverse registered im- 
age; 

binary converting means for converting an original test image into a binary test image so that a 
ratio of black pixels to total pixels lies within a predetermined range; and 

aligning means for aligning said binary test image to said registered image in order to compare 
black pixels of said two images; 

means for judging concordance of said binary test image and said binary registered image wherein 
said binary test image is compared with said binary registered image to evaluate a first degree of con- 
cordance, said binary reversed test image is compared with said binary reverse image to evaluate a sec- 
ond degree of concordance, and said original test image and said original registered image are originated 
from a same object if both said first and second degree of concordance satisfy respective predetermined 
criteria. 



55 



37 



EP 0 623 890 A2 




38 



EP 0 623 890 A2 



FIG. 2A 



4: IMAGE MEMORY 
I 



Q X-COORDINATE-^Xh X-COORDINATE-Xh 



Q 

en 
o 
o 
o 

1 

>- 



-C 

>- 



IMAGE 10 



o 
cc 
o 
o 
o 



x: 
>- 



IMAGE 11 



FIG. 2B 



6: MEMORY 



PROGRAMS 
AND DATA 



REG I STERED 
INFORMATION 



3d 



EP 0 623 890 A2 



FIG. 3A 



P4 


P3 


P2 


P5 


PO 


Pi 


P6 


P7 


P8 



A 3 x 3P I XEL AGGREGATION EXAMPLE 

FIG. 3B 



P15 


P14 


P13 


Pi 2 


P11 


P10 


P9 


P8 


P7 


P6 


P5 


P4 


P3 


P2 


Pi 


PO 



A 4x4 PIXEL AGGREGATION EXAMPLE 

FIG. 3C 



Pi 1 


PlO 


P9 


P8 


P7 


P6 


P5 


P4 


P3 


P2 


Pi 


PO 



A 4X3 PIXEL AGGREGATION EXAMPLE 



40 



EP 0 623 890 A2 



FIG. 4 
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(WITHIN DOTTED LINE) 



ORIGINAL IMAGE REGION 



(0. Yh) 



43 



EP 0 623 890 A2 



FIG. 7 



Bav(M, N): AVERAGE BRIGHTNESS VALUE OF PARTIAL REGION(M. N) 
(0.0) X = K*M - X 



Bav(0. 0) 



Bav(0. 1 ) 



BavOM. 
N-1) 


Bav(M, 
N-1) 


BavCMfl. 
N-1) 






Bav(M-1, 
N) 


Bav(M. N) 


Bav(Mf1. 
N) 






Bav(M-1, 
N+1) 


Bav(M, 
N+1) 


Bav(Mf1. 
N+1) 
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FIG. 9A 



C START ) 



1 








SET Da=0. 

A1m=A2m=A3m=0, 

A1p=A2p=A3p=0 





I 

SET T= AVERAGE BRIGHTNESS VALUE OF PARTIAL REGI0N + D4Da. 
IN TERMS OF THE (X.Y) RANGE IN WHICH PIXEL(X.Y) EXISTS 
IN THE PARTIAL REGION (M,N) AT THIS TIME, i. e. . THECX. Y) 
RANGE IN WHICH K»M^X^K»(M+1 AND K-N^Y<K-(N+1 )-1 : 
WHEN f(X. Y)>T.A WHITE PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A BLACK PIXEL IS DESIGNATED); 
WHEN F(X.Y)<T,A BLACK PIXEL IS DESIGNATED 
(WHEN REVERSING B/W A WHITE PIXEL IS DESIGNATED); 
AT THE TIME OF DETERMINING A WHITE/BLACK PIXEL, 
BLACK PIXELrADD "1" TO BLACK PIXEL COUNTER (Bn) 
WHITE PIXELrADD "1" TO WHITE PIXEL COUNTER (Wn) 



0 



□ 



NOTE:B=BLACK PIXEL 
W=WHITE PIXEL 

(A) INDICATES A JUMP TO ® OF FIG.9B 
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FIG. 9B 



i 



'FOLLOWING BINARY CONVERSION, THE RATIO OF BLACK PIXELS (Bn) 
(TO WHITE PIXELS (Wn) IS CALCULATED, i. e. .CALCULATE Rbw=Bn/(Bn+Wn), i 
, AND THEN EXAMINE WHETHER Rbwl£Rbw£Rbw2 IS VALID OR NOT. 



VALID 



NORMAL 
COMPLETION 
OF BINARY 
.CONVERSION. 



NO 



Rbw>Rbw2 
(BLACK PIXELS 
PREDOMINATE) 



< A1p=0? > 



YES 



SUBSTITUTE Da-Dai 
FOR Da. SET A1m=A1p=1 



Rbw<Rbw1 
(WHITE PIXELS 
.PREDOMINATE) 

lYES ; 



SUBSTITUTE Da+Da1 
FOR Da. SET Alp=Alm=1 



NO 



< A2p=0? > 



I 



1 



,YES 



SUBSTITUTE Da-Da2 
FOR Da. SET A2m=A2p=1 



I 



|YES 



SUBSTITUTE Da+Da2 
FOR Da. SET A2o=A2m=l 



I 



J8(A§b?) 

jYES 



I 



SUBSTITUTE Da-Da3 
FOR Da. SET A3m=1 



|YES 



SUBSTITUTE DaH)a3 
FOR Da. SET A3p=1 



c 



UNSUCCESSFUL COMPLETION OF 
THE BINARY CONVERSION 



NOTE:* INDICATES A JUMP TO * OF FIG.9A 
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FIG. 10 

EXAMPLE OF TABLE G SHOWING VALID REGIONS 

OF A FINGERPRINT (ELEMENT = G (M.N)) 

(WHEN K=16,T INDICATES VALID. "0" INDICATES INVALID; 

SHAPE OF THE FINGERPRINT IMAGE IS UNRELATED TO THE 

OTHER FIGURES) 
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FIG. 1 1 A 
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AN EXAMPLE IN WHICH THE VICINITY 
SURROUNDING PO IS A HOLE 

FIG. 1 1B 
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AN EXAMPLE IN WHICH THE VICINITY 
SURROUNDING Po IS NOT A HOLE 



NOTE:B=BLACK PIXEL 
W= WHITE PIXEL 
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FIG. 12A 
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AN EXAMPLE IN WHICH AN IMAGE MEMORY IS DEVIDED 
USING 4x4 PIXEL AGGREGATIONS 

NOTE:B=BLACK PIXEL. W=WHITE PIXEL 

FIG. 12C 



FIG. 12B 
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LOWER HALF OF A 4x4 PIXEL 
AGGREGATION 

FIG. 12D 
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RIGHT HALF OF A 4x4 PIXEL AGGREGATION 
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FIG. 13A 



C START ) 



I 



STEP CO 



DIVIDE AN INTERVAL [Smin, Smax] OF S INTO AT LEAST 

ONE PARTIAL INTERVAL [Smin(j), Smax( j)]. 

(H.2 Js).AND DETERMINE SELECTION SEQUENCE 



SELECT ONE UNPROCESSED PARTIAL INTERVAL OF S IN 
ACCORDANCE WITH THE SELECTION SEQUENCE. HEREAFTER, 
THE RANGE OF S IS DETERMINED BY THE PARTIAL 
INTERVAL NUMBER j. (j=1. 2. . . . Js). AND PROCESSING 
IS CARRIED OUT 



."STEP CI 



^STEP CI a 



CALCULATE QUASI -OPTIMAL VALUES {Sa.Ha.Va} OF {S.H.V} 



/-STEP Clb 



CALCULATE QUASI -OPTIMAL VALUES {Sb, Hb, Vb} OF {S.H.V} 



/STEP C1c 



CALCULATE QUASI -OPTIMAL VALUES {Sc.Hc.Vc} OF {S.H.V} 




/ST EP CI 



CALCULATE DEGREE OF CONCORDANCE T1(j) OF 
SUB-TEMPLATE WITH REGARD TO PRESENT PARTIAL 
INTERVAL NUMBER OF S; RENDER JUDGMENT 

T1>Tk| 




NOTE: SEE FIG. 13B FOR ®, ® AND © 
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FIG. 15 



C START ) 



fSTEP W1 



SEQUENTIAL SELECTION OF UNPROCESSED ANGLE S 



L 



STEP W2 



CONVERT BLACK PIXEL ADDRESS AGGREGATIONS. Yr)OF THE 
MODIFIED IMAGE OF A REGISTERED FINGERPRINT WITHIN A 
SPECIFIED RANGE (EITHER RT(O) OR RB(O)) TO THE BLACK 
PIXEL ADDRESS AGGREGATION (Xr@,Yr@) OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT BY PARALLEL 
DISPLACEMENT FROM AN APPROXIMATE CENTER POINT AND 
COORDINATE AXIS ROTATION OVER ANGLE S 

1 



/STEP W3 



CALCULATE RATE OF CONCORDANCE FROM THE RATIO OF 
THE BLACK PIXa ADDRESS AGGREGATION OF THE MODIFIED 
IMAGE OF A NEW REGISTERED FINGERPRINT TO THE BLACK 
PIXEL ADDRESS AGGREGATION OF THE MODIFIED IMAGE OF 
A TEST FINGERPRINT. AND THEN PROCEED TO STEP W4.WHEN 
SPECIFIED. A SEARCH IS CONDUCTED FOR A NEIGHBORING 
PIXEL J N_ ORDER T0_ CORRECJ_THE_DJSTORIION _OF_AN_ I MAGE 
IN THE CASE WHEN IT IS POSSIBLE TO ABANDON THE 
COMPARISON DURING THIS PROCESS. THE COMPARISON 
PROCESS IS ABANDONED AT THE DISPLACEMENT POSITION 
{S.H,V}AT THIS TIME. AND TH E PROCEDURE MOVES TO STEP W ^ 

\ /STEP W4 



CALCULATE RATE OF CONCORDANCE AT THE TIME OF 
MODIFYING H. V IN THE SAME MANNER AS IN STEP W3 



UNPROCESSED 
S EXIST 



I 



/STEPW5 



< CHECK WHETHER UNPROCESSED ANGLE S VALUES EXIST> 



UNPROCESSED S DO NOT EXIST 



/STEP W6 



CALCULATE {S. H. V} WHICH WILL MAXIMIZE THE RATES 
OF CONCORDANCE PREVIOUSLY CALCULATED FOR EACH 
RESPECTIVE {S.H.V} AND SET WITH Nm. Nc INTO 
OUTPUT INFORMATION (WHEN ONLY ONE SET {S.H.V} 
IS INPUTTED. THE RATE OF CONCORDANCE OF THIS 
SET REPRESENTS THE OUTPUT INFORMATION) 



( END ) 
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FIG. 16A 

SEARCH EXAMPLE OF NEIGHBORING (APPROXIMATE) AREA 



MODIFIED IMAGE OF 

REGISTERED FINGERPRINT 
r -- T — 



WHITE 
PIXEL 



WHITE 
PIXEL 



WHITE 
PIXEL 



WHITE 
PIXEL 



WHITE 
PIXEL 



BLACK 
PIXEL 
a 

(A) 



WHITE 
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WHITE 
PIXEL 



~! r 



MODIFIED IMAGE OF 
TEST FINGERPRINT 

— i — i — r 
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pixa 



WHITE 
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BLACK 
PIXEL 
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(B) 



BLACK" 
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(A) 


BLACK 
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WHITE 
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WHITE 
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..J L__L 



J_J 



(CONCORDANCE) 



FIG. 16B 

RECIPROCAL RELATIONSHIP OF CONCORDANCE 
AND APPROXIMATE CONCORDANCE 

BLACK PIXEL d OF MODIFIED 
MAGE OF TEST FINGERPRINT 
(ADDRESS=A) 



BLACK PIXEL a OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 
(ADDRESS=A) 



OVERLAP CHECK© 



BLACK PIXEL b OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 
(ADDRESS=B) 



(APPROXIMATE CONCORDANCE) 



V 
/ 



i (CONCORDANCE WITH BLACK 
/ PIXEL a OF MODIFIED IMAGE 
OF REGISTERED FINGERPRINT) 



BLACK PIXEL c OF MODIFIED 
IMAGE OF REGISTERED FINGERPRINT 

(ADDRESS=C) 

(DISCORDANCE) 



BLACK PIXEL e OF MODIFIED 
MAGE OF TEST FINGERPRINT 
(ADDRESS=E) 

, /'(APPROXIMATE CONCORDANCE WITH 
/ /BLACK PIXEL b OF MODIFIED IMAGE 



^OF REGISTERED FINGERPRINT) 
OVERLAP CHECK ® 
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FIG. 18 



( START ) 



STEP RR1 



INPUT SPECIFIED NUMBER OF 
FINGERPRINTS FROM IMAGE 
INPUT UNIT 2 



STEP RR2 



RECIPROCAL COMPARISON OF INPUTTED 
FINGERPRINT IMAGES ACCORDING TO 
A SELECTION PROCESS 



STEP RR3 



WHEN A SPECIFIED NUMBER OF CONCORDANT 

IMAGES RESULTS FROM THE COMPARISON, 

THE REGISTERED INFORMATION OF A 

REGISTERED FINGERPRINT IMAGE AT 

THE TIME OF THE OPTIMUM DEGREE OF CONCORDANCE 

FOR TEMPLATE IS REGISTERED AS AN IMAGE FOR 

REGISTRATION 



C ^D ) 
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FIG. 1 9A ONE TEST FINGERPRINT AND REGISTERED 

INFORMATION FROM N REGISTERED FINGERPRINTS 



REGISTERED 
FINGERPRINT 



— •COMPARISON- 



REGISTERED INFORMATION 1 OF 
REGISTERED FINGERPRINT 1 



REGISTERED INFORMATION 2 OF 
REGISTERED FINGERPRINT 2 



REGISTERED INFORMATION N OF 
REGISTERED FINGERPRINT N 



FIG. 1 9B COMPARISON OF ONE TEST FINGERPRINT AND REGISTERED 
INFORMATION FROM N REGISTERED FINGERPRINTS 



C 



START 



INPUT 



Y 



STEP NA1 



L 



STEP NA2 



UN- 
DETECTED] 



/SEQUENTIAL SELECTION OF PARTIAL SEGMENTS OF 
/ALIGNED INTERVALS WITHOUT OVERLAP (WHEN ALL OF THE 
'PARTIAL SEGMENTS HAVE BEEN SELECTED. THE PROCEDURE; 
(ENDS IN DISCORDANCE), SUBSEQUENTLY. CONDUCT COMPARISON^ 
BY SEQUENTIALLY SELECTING REGISTERED INFORMATION 
i C i=1. 2. — N) ; 

WHEN REGISTERED INFORMATION IS DETECTED FROM THE 
COMPARISON PROCESS WHICH IS CONCORDANT WITH THE 
TEST FINGERPRINT. THIS REGISTERED INFORMATION IS 
JUDGED TO BE CONCORDANT. AND THE PROCEDURE THEN 
^ENDS. AFTER COMPARING ALL REGISTERED INFORMATION 
I WHEN CONCORDANT REGISTERED INFORMATION CANNOT 
\BE DETECTED, THE PROCEDURE RETURNS TO STEP NA2 

™ I CONCORDANT REG I STERED 

\ inf ormation detected 
QnT) 
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FIG. 20B 

COMPARISON 



DISCORDANT 



DIS- 
CORDANT/ 



DISCORDANT 
COMPARISON 



(comparison start) 




STEP RVM1 



BINARY CONVERSION OF GRAY-SCALE IMAGE OF 
TEST FINGERPRINT. COMPARISON PROCESSING OF 
BINARY IMAGE AND REGISTERED INFORMATION. 
AT THIS POINT. OMIT CHECK FOR DEGREE OF 
DISCORDANCE PORTIONS 
(USE OF PROCEDURES C AND W) 



CONCORDANT 



STEP RVM2 



AT THE TIME OF BINARY CONVERSION OF THE 
GRAY-SCALE IMAGE OF TEST FINGERPRINT. 
REVERSE WHITE AND BLACK PIXELS. AND COMPARE 
REVERSE BINARY IMAGE OF TEST FINGERPRINT 
AND REVERSE REGISTERED INFORMATION OF-' 
REGISTERED FINGERPRINT. AT THIS POINT. OMIT 
CHECK FOR DEGREE OF DISCORDANCE PORTIONS 
(USE OF PROCEDURES C AND W) 



CONCORDANT 



CONCORDANT 
COMPARISON 
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